Aug 15 13:18:07 user nova-compute[72863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 13:18:10 user nova-compute[72863]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72863) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 13:18:10 user nova-compute[72863]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72863) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 13:18:10 user nova-compute[72863]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72863) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 13:18:10 user nova-compute[72863]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:18:11 user nova-compute[72863]: INFO nova.virt.driver [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 13:18:11 user nova-compute[72863]: INFO nova.compute.provider_config [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Acquiring lock "singleton_lock" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Acquired lock "singleton_lock" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Releasing lock "singleton_lock" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Full set of CONF: {{(pid=72863) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ******************************************************************************** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Configuration options gathered from: {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ================================================================================ {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] allow_resize_to_same_host      = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] arq_binding_timeout            = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] backdoor_port                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] backdoor_socket                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] block_device_allocate_retries  = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] block_device_allocate_retries_interval = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cert                           = self.pem {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute_monitors               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] config_dir                     = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] config_drive_format            = iso9660 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] config_source                  = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] console_host                   = user {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] control_exchange               = nova {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cpu_allocation_ratio           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] daemon                         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] debug                          = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] default_access_ip_network_name = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] default_availability_zone      = nova {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] default_ephemeral_format       = ext4 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] default_schedule_zone          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] disk_allocation_ratio          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] enable_new_services            = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] enabled_ssl_apis               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] flat_injected                  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] force_config_drive             = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] force_raw_images               = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] graceful_shutdown_timeout      = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] heal_instance_info_cache_interval = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] host                           = user {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_build_timeout         = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_delete_interval       = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_name_template         = instance-%08x {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_usage_audit           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_usage_audit_period    = month {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] internal_service_availability_zone = internal {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] key                            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] live_migration_retry_count     = 30 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_config_append              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_dir                        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_file                       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_options                    = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_rotate_interval            = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_rotate_interval_type       = days {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] log_rotation_type              = none {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] long_rpc_timeout               = 1800 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_concurrent_builds          = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_concurrent_live_migrations = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_concurrent_snapshots       = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_local_block_devices        = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_logfile_count              = 30 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] max_logfile_size_mb            = 200 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] maximum_instance_delete_attempts = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metadata_listen                = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metadata_listen_port           = 8775 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metadata_workers               = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] migrate_max_retries            = -1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] mkisofs_cmd                    = genisoimage {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] my_ip                          = 10.0.0.210 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] network_allocate_retries       = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] osapi_compute_listen_port      = 8774 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] osapi_compute_unique_server_name_scope =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] osapi_compute_workers          = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] password_length                = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] periodic_enable                = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] periodic_fuzzy_delay           = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] pointer_model                  = ps2mouse {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] preallocate_images             = none {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] publish_errors                 = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] pybasedir                      = /opt/stack/nova {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ram_allocation_ratio           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rate_limit_burst               = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rate_limit_except_level        = CRITICAL {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rate_limit_interval            = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reboot_timeout                 = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reclaim_instance_interval      = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] record                         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reimage_timeout_per_gb         = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] report_interval                = 120 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rescue_timeout                 = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reserved_host_cpus             = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reserved_host_disk_mb          = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reserved_host_memory_mb        = 512 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] reserved_huge_pages            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] resize_confirm_window          = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] resize_fs_using_block_device   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] resume_guests_state_on_host_boot = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rpc_response_timeout           = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] run_external_periodic_tasks    = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] running_deleted_instance_action = reap {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] running_deleted_instance_timeout = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler_instance_sync_interval = 120 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_down_time              = 720 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] servicegroup_driver            = db {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] shelved_offload_time           = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] shelved_poll_interval          = 3600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] shutdown_timeout               = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] source_is_ipv6                 = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ssl_only                       = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] state_path                     = /opt/stack/data/nova {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] sync_power_state_interval      = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] sync_power_state_pool_size     = 1000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] syslog_log_facility            = LOG_USER {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] tempdir                        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] timeout_nbd                    = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] transport_url                  = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] update_resources_interval      = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_cow_images                 = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_eventlog                   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_journal                    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_json                       = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_rootwrap_daemon            = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_stderr                     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] use_syslog                     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vcpu_pin_set                   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plugging_is_fatal          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plugging_timeout           = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] virt_mkfs                      = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] volume_usage_poll_interval     = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] watch_log_file                 = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] web                            = /usr/share/spice-html5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_concurrency.disable_process_locking = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.auth_strategy              = keystone {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.compute_link_prefix        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.dhcp_domain                = novalocal {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.enable_instance_password   = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.glance_link_prefix         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.instance_list_per_project_cells = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.list_records_by_skipping_down_cells = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.local_metadata_per_cell    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.max_limit                  = 1000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.metadata_cache_expiration  = 15 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.neutron_default_tenant_id  = default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.use_forwarded_for          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.use_neutron_default_nets   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_dynamic_targets = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_jsonfile_path   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.backend_argument         = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.config_prefix            = cache.oslo {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.dead_timeout             = 60.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.debug_cache_backend      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.enable_retry_client      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.enable_socket_keepalive  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.enabled                  = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.expiration_time          = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.hashclient_retry_attempts = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_dead_retry      = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_password        =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_sasl_enabled    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.memcache_username        =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.proxies                  = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.retry_attempts           = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.retry_delay              = 0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.socket_keepalive_count   = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.socket_keepalive_idle    = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.socket_keepalive_interval = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.tls_allowed_ciphers      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.tls_cafile               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.tls_certfile             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.tls_enabled              = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cache.tls_keyfile              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.auth_section            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.auth_type               = password {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.cafile                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.certfile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.collect_timing          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.cross_az_attach         = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.debug                   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.endpoint_template       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.http_retries            = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.insecure                = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.keyfile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.os_region_name          = RegionOne {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.split_loggers           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cinder.timeout                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.cpu_dedicated_set      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.cpu_shared_set         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.image_type_exclude_list = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.resource_provider_association_refresh = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.shutdown_retry_interval = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] conductor.workers              = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] console.allowed_origins        = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] console.ssl_ciphers            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] console.ssl_minimum_version    = default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] consoleauth.token_ttl          = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.cafile                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.certfile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.collect_timing          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.connect_retries         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.connect_retry_delay     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.endpoint_override       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.insecure                = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.keyfile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.max_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.min_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.region_name             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.service_name            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.service_type            = accelerator {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.split_loggers           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.status_code_retries     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.timeout                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] cyborg.version                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.backend               = sqlalchemy {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.connection            = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.connection_debug      = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.connection_parameters =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.connection_recycle_time = 3600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.connection_trace      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.db_inc_retry_interval = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.db_max_retries        = 20 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.db_max_retry_interval = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.db_retry_interval     = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.max_overflow          = 50 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.max_pool_size         = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.max_retries           = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.mysql_enable_ndb      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.mysql_wsrep_sync_wait = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.pool_timeout          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.retry_interval        = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.slave_connection      = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] database.sqlite_synchronous    = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.backend           = sqlalchemy {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.connection        = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.connection_debug  = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.connection_parameters =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.connection_recycle_time = 3600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.connection_trace  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.db_inc_retry_interval = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.db_max_retries    = 20 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.db_max_retry_interval = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.db_retry_interval = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.max_overflow      = 50 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.max_pool_size     = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.max_retries       = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.mysql_enable_ndb  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.pool_timeout      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.retry_interval    = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.slave_connection  = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] api_database.sqlite_synchronous = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] devices.enabled_mdev_types     = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ephemeral_storage_encryption.enabled = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.api_servers             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.cafile                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.certfile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.collect_timing          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.connect_retries         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.connect_retry_delay     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.debug                   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.default_trusted_certificate_ids = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.enable_certificate_validation = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.enable_rbd_download     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.endpoint_override       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.insecure                = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.keyfile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.max_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.min_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.num_retries             = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.rbd_ceph_conf           =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.rbd_connect_timeout     = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.rbd_pool                =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.rbd_user                =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.region_name             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.service_name            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.service_type            = image {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.split_loggers           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.status_code_retries     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.timeout                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.verify_glance_signatures = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] glance.version                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] guestfs.debug                  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.config_drive_cdrom      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.config_drive_inject_password = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.enable_remotefx         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.instances_path_share    =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.limit_cpu_features      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.use_multipath_io        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.vswitch_name            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] mks.enabled                    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.manager_interval   = 2400 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.precache_concurrency = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.remove_unused_base_images = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] image_cache.subdirectory_name  = _base {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.api_max_retries         = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.api_retry_interval      = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.auth_section            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.auth_type               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.cafile                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.certfile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.collect_timing          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.connect_retries         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.connect_retry_delay     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.endpoint_override       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.insecure                = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.keyfile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.max_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.min_version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.partition_key           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.peer_list               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.region_name             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.serial_console_state_timeout = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.service_name            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.service_type            = baremetal {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.split_loggers           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.status_code_retries     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.timeout                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ironic.version                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] key_manager.fixed_key          = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.barbican_api_version  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.barbican_endpoint     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.barbican_endpoint_type = public {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.barbican_region_name  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.cafile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.certfile              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.collect_timing        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.insecure              = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.keyfile               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.number_of_retries     = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.retry_delay           = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.send_service_user_token = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.split_loggers         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.timeout               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.verify_ssl            = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican.verify_ssl_path       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.auth_section = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.auth_type = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.cafile   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.certfile = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.collect_timing = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.insecure = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.keyfile  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.split_loggers = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] barbican_service_user.timeout  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.approle_role_id          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.approle_secret_id        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.cafile                   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.certfile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.collect_timing           = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.insecure                 = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.keyfile                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.kv_mountpoint            = secret {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.kv_version               = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.namespace                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.root_token_id            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.split_loggers            = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.ssl_ca_crt_file          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.timeout                  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.use_ssl                  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.cafile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.certfile              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.collect_timing        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.connect_retries       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.connect_retry_delay   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.endpoint_override     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.insecure              = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.keyfile               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.max_version           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.min_version           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.region_name           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.service_name          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.service_type          = identity {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.split_loggers         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.status_code_retries   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.timeout               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] keystone.version               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.connection_uri         =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_mode               = custom {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: WARNING oslo_config.cfg [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_power_governor_high = performance {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_power_management   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.device_detach_attempts = 8 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.device_detach_timeout  = 20 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.disk_cachemodes        = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.disk_prefix            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.enabled_perf_events    = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.file_backed_memory     = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.gid_maps               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.hw_disk_discard        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.hw_machine_type        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_rbd_pool        = rbd {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_type            = default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.images_volume_group    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.inject_key             = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.inject_partition       = -2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.inject_password        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.iscsi_iface            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.iser_use_multipath     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_downtime = 500 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_inbound_addr = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_scheme  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_timeout_action = abort {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_tunnelled = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: WARNING oslo_config.cfg [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 13:18:11 user nova-compute[72863]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 13:18:11 user nova-compute[72863]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 13:18:11 user nova-compute[72863]: and ``live_migration_inbound_addr`` respectively.
Aug 15 13:18:11 user nova-compute[72863]: ).  Its value may be silently ignored in the future.
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.live_migration_with_native_tls = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.max_queues             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.nfs_mount_options      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_pcie_ports         = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.pmem_namespaces        = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.quobyte_client_cfg     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rbd_secret_uuid        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rbd_user               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rescue_image_id        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rescue_kernel_id       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.rx_queue_size          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.smbfs_mount_options    =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.snapshot_compression   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.snapshot_image_format  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.sparse_logical_volumes = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.swtpm_enabled          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.swtpm_group            = tss {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.swtpm_user             = tss {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.sysinfo_serial         = unique {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.tb_cache_size          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.tx_queue_size          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.uid_maps               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.use_virtio_for_bridges = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.virt_type              = kvm {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.volume_clear           = zero {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.volume_clear_size      = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.volume_use_multipath   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_cache_path   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.auth_section           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.auth_type              = password {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.cafile                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.certfile               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.collect_timing         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.connect_retries        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.connect_retry_delay    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.default_floating_pool  = public {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.endpoint_override      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.extension_sync_interval = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.http_retries           = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.insecure               = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.keyfile                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.max_version            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.min_version            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.ovs_bridge             = br-int {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.physnets               = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.region_name            = RegionOne {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.service_metadata_proxy = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.service_name           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.service_type           = network {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.split_loggers          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.status_code_retries    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.timeout                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] neutron.version                = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] notifications.bdms_in_notifications = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] notifications.default_level    = INFO {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] notifications.notification_format = unversioned {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] notifications.notify_on_state_change = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] pci.alias                      = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] pci.device_spec                = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] pci.report_in_placement        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.auth_section         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.auth_type            = password {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.cafile               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.certfile             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.collect_timing       = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.connect_retries      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.connect_retry_delay  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.default_domain_id    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.default_domain_name  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.domain_id            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.domain_name          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.endpoint_override    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.insecure             = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.keyfile              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.max_version          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.min_version          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.password             = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.project_domain_id    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.project_domain_name  = Default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.project_id           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.project_name         = service {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.region_name          = RegionOne {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.service_name         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.service_type         = placement {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.split_loggers        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.status_code_retries  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.system_scope         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.timeout              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.trust_id             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.user_domain_id       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.user_domain_name     = Default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.user_id              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.username             = placement {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] placement.version              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.cores                    = 20 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.count_usage_from_placement = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.injected_file_content_bytes = 10240 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.injected_file_path_length = 255 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.injected_files           = 5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.instances                = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.key_pairs                = 100 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.metadata_items           = 128 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.ram                      = 51200 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.recheck_quota            = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.server_group_members     = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] quota.server_groups            = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rdp.enabled                    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.image_metadata_prefilter = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.max_attempts         = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.max_placement_results = 1000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] scheduler.workers              = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.host_subset_size = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.isolated_hosts = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.isolated_images = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.pci_in_placement = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.track_instance_changes = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metrics.required               = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metrics.weight_multiplier      = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] metrics.weight_setting         = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.enabled         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.port_range      = 10000:20000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] serial_console.serialproxy_port = 6083 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.auth_section      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.auth_type         = password {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.cafile            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.certfile          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.collect_timing    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.insecure          = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.keyfile           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.send_service_user_token = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.split_loggers     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] service_user.timeout           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.agent_enabled            = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.enabled                  = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.html5proxy_port          = 6082 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.image_compression        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.jpeg_compression         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.playback_compression     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.server_listen            = 127.0.0.1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.streaming_mode           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] spice.zlib_compression         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] upgrade_levels.baseapi         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] upgrade_levels.cert            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] upgrade_levels.compute         = auto {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] upgrade_levels.conductor       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] upgrade_levels.scheduler       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.cafile = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.certfile = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.insecure = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vendordata_dynamic_auth.timeout = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.api_retry_count         = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.ca_file                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.cache_prefix            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.cluster_name            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.connection_pool_size    = 10 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.console_delay_seconds   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.datastore_regex         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.host_ip                 = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.host_password           = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.host_port               = 443 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.host_username           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.insecure                = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.integration_bridge      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.maximum_objects         = 100 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.pbm_default_policy      = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.pbm_enabled             = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.pbm_wsdl_location       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.serial_port_proxy_uri   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.serial_port_service_uri = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.task_poll_interval      = 0.5 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.use_linked_clone        = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.vnc_keymap              = en-us {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.vnc_port                = 5900 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vmware.vnc_port_total          = 10000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.auth_schemes               = ['none'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.enabled                    = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.novncproxy_port            = 6080 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.vencrypt_ca_certs          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.vencrypt_client_cert       = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vnc.vencrypt_client_key        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.disable_rootwrap   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.enable_numa_live_migration = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.libvirt_disable_apic = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.client_socket_timeout     = 900 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.default_pool_size         = 1000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.keep_alive                = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.max_header_line           = 16384 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.ssl_ca_file               = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.ssl_cert_file             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.ssl_key_file              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.tcp_keepidle              = 600 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] zvm.ca_file                    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] zvm.cloud_connector_url        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] zvm.reachable_timeout          = 300 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.enforce_new_defaults = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.enforce_scope      = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.policy_default_rule = default {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.connection_string     = messaging:// {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.enabled               = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.es_doc_type           = notification {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.es_scroll_size        = 10000 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.es_scroll_time        = 2m {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.filter_error_trace    = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.hmac_keys             = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.sentinel_service_name = mymaster {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.socket_timeout        = 0.1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.trace_requests        = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler.trace_sqlalchemy      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler_jaeger.process_tags   = {} {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler_jaeger.service_name_prefix = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] profiler_otlp.service_name_prefix = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] remote_debug.host              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] remote_debug.port              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_notifications.retry = -1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.auth_section        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.auth_type           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.cafile              = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.certfile            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.collect_timing      = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.connect_retries     = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.connect_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.endpoint_id         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.endpoint_override   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.insecure            = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.keyfile             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.max_version         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.min_version         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.region_name         = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.service_name        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.service_type        = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.split_loggers       = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.status_code_retries = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.status_code_retry_delay = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.timeout             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.valid_interfaces    = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_limit.version             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_reports.file_event_handler = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] oslo_reports.log_dir           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.group  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] vif_plug_ovs_privileged.user   = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.isolate_vif         = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] os_brick.lock_path             = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.capabilities   = [21] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.group          = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.helper_command = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] privsep_osbrick.user           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.group           = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.helper_command  = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] nova_sys_admin.user            = None {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG oslo_service.service [None req-13bcd7c9-5c4a-4245-b138-4959312eda30 None None] ******************************************************************************** {{(pid=72863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 13:18:11 user nova-compute[72863]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Starting native event thread {{(pid=72863) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Starting green dispatch thread {{(pid=72863) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Starting connection event dispatch thread {{(pid=72863) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Connecting to libvirt: qemu:///system {{(pid=72863) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff525388cd0> {{(pid=72863) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff525388cd0> {{(pid=72863) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 13:18:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Connection event '1' reason 'None'
Aug 15 13:18:11 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 13:18:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.mount [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Initialising _HostMountState generation 0 {{(pid=72863) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host capabilities <capabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <host>
Aug 15 13:18:19 user nova-compute[72863]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 13:18:19 user nova-compute[72863]:     <cpu>
Aug 15 13:18:19 user nova-compute[72863]:       <arch>x86_64</arch>
Aug 15 13:18:19 user nova-compute[72863]:       <model>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <microcode version='1070'/>
Aug 15 13:18:19 user nova-compute[72863]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='osxsave'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='invtsc'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='rsba'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 13:18:19 user nova-compute[72863]:       <pages unit='KiB' size='4'/>
Aug 15 13:18:19 user nova-compute[72863]:       <pages unit='KiB' size='2048'/>
Aug 15 13:18:19 user nova-compute[72863]:     </cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <power_management>
Aug 15 13:18:19 user nova-compute[72863]:       <suspend_mem/>
Aug 15 13:18:19 user nova-compute[72863]:       <suspend_disk/>
Aug 15 13:18:19 user nova-compute[72863]:       <suspend_hybrid/>
Aug 15 13:18:19 user nova-compute[72863]:     </power_management>
Aug 15 13:18:19 user nova-compute[72863]:     <iommu support='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <migration_features>
Aug 15 13:18:19 user nova-compute[72863]:       <live/>
Aug 15 13:18:19 user nova-compute[72863]:       <uri_transports>
Aug 15 13:18:19 user nova-compute[72863]:         <uri_transport>tcp</uri_transport>
Aug 15 13:18:19 user nova-compute[72863]:         <uri_transport>rdma</uri_transport>
Aug 15 13:18:19 user nova-compute[72863]:       </uri_transports>
Aug 15 13:18:19 user nova-compute[72863]:     </migration_features>
Aug 15 13:18:19 user nova-compute[72863]:     <topology>
Aug 15 13:18:19 user nova-compute[72863]:       <cells num='2'>
Aug 15 13:18:19 user nova-compute[72863]:         <cell id='0'>
Aug 15 13:18:19 user nova-compute[72863]:           <memory unit='KiB'>8140616</memory>
Aug 15 13:18:19 user nova-compute[72863]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 15 13:18:19 user nova-compute[72863]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 13:18:19 user nova-compute[72863]:           <distances>
Aug 15 13:18:19 user nova-compute[72863]:             <sibling id='0' value='10'/>
Aug 15 13:18:19 user nova-compute[72863]:             <sibling id='1' value='20'/>
Aug 15 13:18:19 user nova-compute[72863]:           </distances>
Aug 15 13:18:19 user nova-compute[72863]:           <cpus num='6'>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 13:18:19 user nova-compute[72863]:           </cpus>
Aug 15 13:18:19 user nova-compute[72863]:         </cell>
Aug 15 13:18:19 user nova-compute[72863]:         <cell id='1'>
Aug 15 13:18:19 user nova-compute[72863]:           <memory unit='KiB'>8255068</memory>
Aug 15 13:18:19 user nova-compute[72863]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 15 13:18:19 user nova-compute[72863]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 13:18:19 user nova-compute[72863]:           <distances>
Aug 15 13:18:19 user nova-compute[72863]:             <sibling id='0' value='20'/>
Aug 15 13:18:19 user nova-compute[72863]:             <sibling id='1' value='10'/>
Aug 15 13:18:19 user nova-compute[72863]:           </distances>
Aug 15 13:18:19 user nova-compute[72863]:           <cpus num='6'>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 13:18:19 user nova-compute[72863]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 13:18:19 user nova-compute[72863]:           </cpus>
Aug 15 13:18:19 user nova-compute[72863]:         </cell>
Aug 15 13:18:19 user nova-compute[72863]:       </cells>
Aug 15 13:18:19 user nova-compute[72863]:     </topology>
Aug 15 13:18:19 user nova-compute[72863]:     <cache>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 13:18:19 user nova-compute[72863]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 13:18:19 user nova-compute[72863]:     </cache>
Aug 15 13:18:19 user nova-compute[72863]:     <secmodel>
Aug 15 13:18:19 user nova-compute[72863]:       <model>apparmor</model>
Aug 15 13:18:19 user nova-compute[72863]:       <doi>0</doi>
Aug 15 13:18:19 user nova-compute[72863]:     </secmodel>
Aug 15 13:18:19 user nova-compute[72863]:     <secmodel>
Aug 15 13:18:19 user nova-compute[72863]:       <model>dac</model>
Aug 15 13:18:19 user nova-compute[72863]:       <doi>0</doi>
Aug 15 13:18:19 user nova-compute[72863]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 13:18:19 user nova-compute[72863]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 13:18:19 user nova-compute[72863]:     </secmodel>
Aug 15 13:18:19 user nova-compute[72863]:   </host>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='alpha'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>clipper</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='armv6l'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>spitz</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>nuri</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>kzm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>z2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>tosa</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n810</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>terrier</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>midway</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>microbit</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>verdex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>highbank</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>akita</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>connex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>collie</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='armv7l'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>spitz</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>nuri</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>kzm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>z2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>tosa</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n810</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>terrier</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>midway</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>microbit</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>verdex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>highbank</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>akita</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>connex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>collie</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='aarch64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>spitz</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>nuri</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>kzm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>z2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>tosa</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n810</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>n800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>terrier</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>midway</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>microbit</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>verdex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>highbank</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>akita</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>connex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>collie</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <acpi default='on' toggle='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='cris'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='i686'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>isapc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>microvm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='kvm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <pae/>
Aug 15 13:18:19 user nova-compute[72863]:       <nonpae/>
Aug 15 13:18:19 user nova-compute[72863]:       <acpi default='on' toggle='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:       <apic default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='m68k'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>an5206</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>q800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='microblaze'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='microblazeel'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='mips'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>malta</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='mipsel'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>malta</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='mips64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>malta</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>pica61</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>magnum</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='mips64el'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>malta</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>pica61</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>magnum</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='16'>boston</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='ppc'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mac99</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>40p</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>taihu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='ppc64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>taihu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>40p</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mac99</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='ppc64le'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>taihu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>40p</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>mac99</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='riscv32'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='8'>spike</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='8'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='riscv64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='8'>spike</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='8'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='s390x'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='sh4'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>shix</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>r2d</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='sh4eb'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>shix</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>r2d</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='sparc'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>LX</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='sparc64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>niagara</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='x86_64'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>64</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='1'>isapc</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>microvm</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='kvm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <acpi default='on' toggle='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:       <apic default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='xtensa'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>sim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>kc705</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ml605</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx200</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx60</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]:   <guest>
Aug 15 13:18:19 user nova-compute[72863]:     <os_type>hvm</os_type>
Aug 15 13:18:19 user nova-compute[72863]:     <arch name='xtensaeb'>
Aug 15 13:18:19 user nova-compute[72863]:       <wordsize>32</wordsize>
Aug 15 13:18:19 user nova-compute[72863]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='4'>sim</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>kc705</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ml605</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>virt</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx200</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>lx60</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 13:18:19 user nova-compute[72863]:       <domain type='qemu'/>
Aug 15 13:18:19 user nova-compute[72863]:     </arch>
Aug 15 13:18:19 user nova-compute[72863]:     <features>
Aug 15 13:18:19 user nova-compute[72863]:       <cpuselection/>
Aug 15 13:18:19 user nova-compute[72863]:       <deviceboot/>
Aug 15 13:18:19 user nova-compute[72863]:       <disksnapshot default='on' toggle='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     </features>
Aug 15 13:18:19 user nova-compute[72863]:   </guest>
Aug 15 13:18:19 user nova-compute[72863]: </capabilities>
Aug 15 13:18:19 user nova-compute[72863]: 
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-i440fx-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>i686</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='255'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'/>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='lm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ide</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-i440fx-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>i686</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='255'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'/>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='lm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ide</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-q35-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>i686</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='288'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'/>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='lm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-q35-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>i686</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='288'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'/>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='lm'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-i440fx-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>x86_64</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='255'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>efi</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='invtsc'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='rsba'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ide</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-i440fx-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>x86_64</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='255'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>efi</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='invtsc'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='rsba'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ide</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-q35-6.2</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>x86_64</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='288'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>efi</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='invtsc'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='rsba'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 13:18:19 user nova-compute[72863]: <domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 13:18:19 user nova-compute[72863]:   <domain>kvm</domain>
Aug 15 13:18:19 user nova-compute[72863]:   <machine>pc-q35-jammy</machine>
Aug 15 13:18:19 user nova-compute[72863]:   <arch>x86_64</arch>
Aug 15 13:18:19 user nova-compute[72863]:   <vcpu max='288'/>
Aug 15 13:18:19 user nova-compute[72863]:   <iothreads supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:   <os supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='firmware'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>efi</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:     <loader supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>rom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pflash</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='readonly'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='secure'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>yes</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>no</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </loader>
Aug 15 13:18:19 user nova-compute[72863]:   </os>
Aug 15 13:18:19 user nova-compute[72863]:   <cpu>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-passthrough' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='hostPassthroughMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='maximum' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='maximumMigratable'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>on</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>off</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='host-model' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <vendor>Intel</vendor>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ss'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='vmx'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pcid'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='hypervisor'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arat'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='umip'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='md-clear'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='invtsc'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibpb'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='ibrs'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-stibp'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='rsba'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='erms'/>
Aug 15 13:18:19 user nova-compute[72863]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:     <mode name='custom' supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>qemu64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>qemu32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>phenom</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>pentium</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>n270</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm64</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>kvm32</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>coreduo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>core2duo</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>athlon</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Westmere</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Snowridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Skylake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>SandyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Penryn</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G5</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G4</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G3</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Opteron_G2</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Opteron_G1</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>IvyBridge</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Icelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Haswell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Rome</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-Milan</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>EPYC</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Dhyana</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cooperlake</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>Conroe</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='no'>Broadwell</model>
Aug 15 13:18:19 user nova-compute[72863]:       <model usable='yes'>486</model>
Aug 15 13:18:19 user nova-compute[72863]:     </mode>
Aug 15 13:18:19 user nova-compute[72863]:   </cpu>
Aug 15 13:18:19 user nova-compute[72863]:   <memoryBacking supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:     <enum name='sourceType'>
Aug 15 13:18:19 user nova-compute[72863]:       <value>file</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>anonymous</value>
Aug 15 13:18:19 user nova-compute[72863]:       <value>memfd</value>
Aug 15 13:18:19 user nova-compute[72863]:     </enum>
Aug 15 13:18:19 user nova-compute[72863]:   </memoryBacking>
Aug 15 13:18:19 user nova-compute[72863]:   <devices>
Aug 15 13:18:19 user nova-compute[72863]:     <disk supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='diskDevice'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>disk</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cdrom</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>floppy</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>lun</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='bus'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>fdc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sata</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </disk>
Aug 15 13:18:19 user nova-compute[72863]:     <graphics supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='type'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>sdl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vnc</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>spice</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egl-headless</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </graphics>
Aug 15 13:18:19 user nova-compute[72863]:     <video supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='modelType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>cirrus</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>vmvga</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>qxl</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>none</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>bochs</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>ramfb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </video>
Aug 15 13:18:19 user nova-compute[72863]:     <hostdev supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='mode'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>subsystem</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='startupPolicy'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>default</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>mandatory</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>requisite</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>optional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='subsysType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>usb</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>pci</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>scsi</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='capsType'/>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='pciBackend'/>
Aug 15 13:18:19 user nova-compute[72863]:     </hostdev>
Aug 15 13:18:19 user nova-compute[72863]:     <rng supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtio-non-transitional</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>random</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>egd</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>builtin</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </rng>
Aug 15 13:18:19 user nova-compute[72863]:     <filesystem supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='driverType'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>path</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>handle</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>virtiofs</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </filesystem>
Aug 15 13:18:19 user nova-compute[72863]:     <tpm supported='yes'>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='model'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-tis</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>tpm-crb</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:       <enum name='backendModel'>
Aug 15 13:18:19 user nova-compute[72863]:         <value>passthrough</value>
Aug 15 13:18:19 user nova-compute[72863]:         <value>emulator</value>
Aug 15 13:18:19 user nova-compute[72863]:       </enum>
Aug 15 13:18:19 user nova-compute[72863]:     </tpm>
Aug 15 13:18:19 user nova-compute[72863]:   </devices>
Aug 15 13:18:19 user nova-compute[72863]:   <features>
Aug 15 13:18:19 user nova-compute[72863]:     <gic supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:     <vmcoreinfo supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <genid supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backingStoreInput supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <backup supported='yes'/>
Aug 15 13:18:19 user nova-compute[72863]:     <sev supported='no'/>
Aug 15 13:18:19 user nova-compute[72863]:   </features>
Aug 15 13:18:19 user nova-compute[72863]: </domainCapabilities>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72863) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72863) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Checking secure boot support for host arch (x86_64) {{(pid=72863) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Checking secure boot support for host arch (x86_64) {{(pid=72863) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Checking secure boot support for host arch (x86_64) {{(pid=72863) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Checking secure boot support for host arch (x86_64) {{(pid=72863) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Checking secure boot support for host arch (x86_64) {{(pid=72863) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Secure Boot support detected
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] cpu compare xml: <cpu match="exact">
Aug 15 13:18:19 user nova-compute[72863]:   <model>Nehalem</model>
Aug 15 13:18:19 user nova-compute[72863]: </cpu>
Aug 15 13:18:19 user nova-compute[72863]:  {{(pid=72863) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.virt.node [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Generated node identity ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.virt.node [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Wrote node identity ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 to /opt/stack/data/nova/compute_id
Aug 15 13:18:19 user nova-compute[72863]: WARNING nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Compute nodes ['ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 13:18:19 user nova-compute[72863]: WARNING nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 13:18:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:18:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:18:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:18:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Hypervisor/Node resource view: name=user free_ram=10874MB free_disk=26.498538970947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:18:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:18:19 user nova-compute[72863]: WARNING nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] No compute node record for user:ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 could not be found.
Aug 15 13:18:19 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Compute node record created for user:user with uuid: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:18:20 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [req-194eae71-f3fc-4599-9bc9-30b468fc3493] Created resource provider record via placement API for resource provider with UUID ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 and name user.
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72863) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 13:18:20 user nova-compute[72863]: INFO nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] kernel doesn't support AMD SEV
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Libvirt baseline CPU <cpu>
Aug 15 13:18:20 user nova-compute[72863]:   <arch>x86_64</arch>
Aug 15 13:18:20 user nova-compute[72863]:   <model>Nehalem</model>
Aug 15 13:18:20 user nova-compute[72863]:   <vendor>Intel</vendor>
Aug 15 13:18:20 user nova-compute[72863]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 13:18:20 user nova-compute[72863]: </cpu>
Aug 15 13:18:20 user nova-compute[72863]:  {{(pid=72863) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Updated inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Updating resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 generation from 0 to 1 during operation: update_inventory {{(pid=72863) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Updating resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 generation from 1 to 2 during operation: update_traits {{(pid=72863) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.service [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Creating RPC server for service compute {{(pid=72863) start /opt/stack/nova/nova/service.py:182}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.service [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Join ServiceGroup membership for this service compute {{(pid=72863) start /opt/stack/nova/nova/service.py:199}}
Aug 15 13:18:20 user nova-compute[72863]: DEBUG nova.servicegroup.drivers.db [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72863) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 13:18:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_power_states {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:18:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:19:11 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:19:11 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=10270MB free_disk=26.402301788330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:19:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:20:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:20:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:20:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=10249MB free_disk=26.460407257080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:20:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:20:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:21:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:21:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=10172MB free_disk=26.234989166259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:21:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.099s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:21:14 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:15 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:21:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:21:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:21:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:21:15 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:22:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:12 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=9539MB free_disk=26.26513671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:22:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:14 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:22:15 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:15 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:15 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:22:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:22:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:22:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:17 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:22:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:22:33 user nova-compute[72863]: INFO nova.compute.claims [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Claim successful on node user
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:22:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:22:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Creating image(s)
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "/opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "/opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "/opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.part --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG nova.virt.images [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] 40a3270d-656b-4d7d-8be8-25ab1ae5fd35 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.part /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG nova.policy [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44ee4fd69fb1480d8b93941b8867ae52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa26bb5186046a7bbdbfecbe9e7b2e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.part /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.converted" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.141s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:35 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzr1f5qi4/privsep.sock']
Aug 15 13:22:35 user sudo[82128]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzr1f5qi4/privsep.sock
Aug 15 13:22:35 user sudo[82128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 13:22:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:22:36 user nova-compute[72863]: INFO nova.compute.claims [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Claim successful on node user
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:22:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:22:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:22:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Creating image(s)
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:37 user sudo[82128]: pam_unix(sudo:session): session closed for user root
Aug 15 13:22:37 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Spawned new privsep daemon via rootwrap
Aug 15 13:22:37 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 13:22:37 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 13:22:37 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 13:22:37 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82139
Aug 15 13:22:37 user nova-compute[72863]: WARNING oslo_privsep.priv_context [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] privsep daemon already running
Aug 15 13:22:37 user nova-compute[72863]: DEBUG nova.policy [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f28612e758464797a56a4b7ea233ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e9e6721b634d2fb974f7a10c6e0359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.157s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.218s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Successfully created port: 6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk 1073741824" returned: 0 in 0.050s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.235s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.155s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk 1073741824" returned: 0 in 0.049s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Cannot resize image /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lazy-loading 'migration_context' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Ensure instance console log exists: /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:22:38 user nova-compute[72863]: INFO nova.compute.claims [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Claim successful on node user
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Cannot resize image /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.objects.instance [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'migration_context' on Instance uuid 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Ensure instance console log exists: /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.244s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:22:38 user nova-compute[72863]: INFO nova.compute.claims [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Claim successful on node user
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:22:38 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:22:38 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Creating image(s)
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "/opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.policy [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e68128a64baa4eb89f1454f94115ae1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f776a79a5746ae840d47da420daedc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:22:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.245s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk 1073741824" returned: 0 in 0.054s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.policy [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acc0646305654477852de0c8bdebce90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '974e84d7fd49440bb0449944cc4ffa94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:22:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Creating image(s)
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Cannot resize image /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'migration_context' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Ensure instance console log exists: /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk 1073741824" returned: 0 in 0.041s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Successfully created port: 4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Cannot resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'migration_context' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Ensure instance console log exists: /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Successfully updated port: 6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquired lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:40 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:22:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-changed-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:22:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Refreshing instance network info cache due to event network-changed-6082c7b7-5fa7-45e5-8d35-6761319d72d0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:22:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] Acquiring lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:41 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:22:41 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Successfully created port: 2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Successfully created port: 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updating instance_info_cache with network_info: [{"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Releasing lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Instance network_info: |[{"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] Acquired lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Refreshing network info cache for port 6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Start _get_guest_xml network_info=[{"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:22:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1061813752',display_name='tempest-DeleteServersTestJSON-server-1061813752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1061813752',id=1,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aa26bb5186046a7bbdbfecbe9e7b2e1',ramdisk_id='',reservation_id='r-s1ehktzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1460024248',owner_user_name='tempest-DeleteServersTestJSON-1460024248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:34Z,user_data=None,user_id='44ee4fd69fb1480d8b93941b8867ae52',uuid=9da5205c-ed07-4087-87b3-1c49f309154a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converting VIF {"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lazy-loading 'pci_devices' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:22:42 user nova-compute[72863]:   <uuid>9da5205c-ed07-4087-87b3-1c49f309154a</uuid>
Aug 15 13:22:42 user nova-compute[72863]:   <name>instance-00000001</name>
Aug 15 13:22:42 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:22:42 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:22:42 user nova-compute[72863]:   <metadata>
Aug 15 13:22:42 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:22:42 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:name>tempest-DeleteServersTestJSON-server-1061813752</nova:name>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:22:42</nova:creationTime>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:22:42 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:22:42 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:owner>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:user uuid="44ee4fd69fb1480d8b93941b8867ae52">tempest-DeleteServersTestJSON-1460024248-project-member</nova:user>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:project uuid="9aa26bb5186046a7bbdbfecbe9e7b2e1">tempest-DeleteServersTestJSON-1460024248</nova:project>
Aug 15 13:22:42 user nova-compute[72863]:       </nova:owner>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:22:42 user nova-compute[72863]:       <nova:ports>
Aug 15 13:22:42 user nova-compute[72863]:         <nova:port uuid="6082c7b7-5fa7-45e5-8d35-6761319d72d0">
Aug 15 13:22:42 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:22:42 user nova-compute[72863]:         </nova:port>
Aug 15 13:22:42 user nova-compute[72863]:       </nova:ports>
Aug 15 13:22:42 user nova-compute[72863]:     </nova:instance>
Aug 15 13:22:42 user nova-compute[72863]:   </metadata>
Aug 15 13:22:42 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:22:42 user nova-compute[72863]:     <system>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="serial">9da5205c-ed07-4087-87b3-1c49f309154a</entry>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="uuid">9da5205c-ed07-4087-87b3-1c49f309154a</entry>
Aug 15 13:22:42 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:22:42 user nova-compute[72863]:     </system>
Aug 15 13:22:42 user nova-compute[72863]:   </sysinfo>
Aug 15 13:22:42 user nova-compute[72863]:   <os>
Aug 15 13:22:42 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:22:42 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:22:42 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:22:42 user nova-compute[72863]:   </os>
Aug 15 13:22:42 user nova-compute[72863]:   <features>
Aug 15 13:22:42 user nova-compute[72863]:     <acpi/>
Aug 15 13:22:42 user nova-compute[72863]:     <apic/>
Aug 15 13:22:42 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:22:42 user nova-compute[72863]:   </features>
Aug 15 13:22:42 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:22:42 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:22:42 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:22:42 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:22:42 user nova-compute[72863]:   </clock>
Aug 15 13:22:42 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:22:42 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:22:42 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:22:42 user nova-compute[72863]:   </cpu>
Aug 15 13:22:42 user nova-compute[72863]:   <devices>
Aug 15 13:22:42 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:22:42 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:22:42 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk"/>
Aug 15 13:22:42 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:22:42 user nova-compute[72863]:     </disk>
Aug 15 13:22:42 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:22:42 user nova-compute[72863]:       <mac address="fa:16:3e:af:87:33"/>
Aug 15 13:22:42 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:42 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:22:42 user nova-compute[72863]:       <target dev="tap6082c7b7-5f"/>
Aug 15 13:22:42 user nova-compute[72863]:     </interface>
Aug 15 13:22:42 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:22:42 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/console.log" append="off"/>
Aug 15 13:22:42 user nova-compute[72863]:     </serial>
Aug 15 13:22:42 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:22:42 user nova-compute[72863]:     <video>
Aug 15 13:22:42 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:42 user nova-compute[72863]:     </video>
Aug 15 13:22:42 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:22:42 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:22:42 user nova-compute[72863]:     </rng>
Aug 15 13:22:42 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:22:42 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:22:42 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:22:42 user nova-compute[72863]:     </memballoon>
Aug 15 13:22:42 user nova-compute[72863]:   </devices>
Aug 15 13:22:42 user nova-compute[72863]: </domain>
Aug 15 13:22:42 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1061813752',display_name='tempest-DeleteServersTestJSON-server-1061813752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1061813752',id=1,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aa26bb5186046a7bbdbfecbe9e7b2e1',ramdisk_id='',reservation_id='r-s1ehktzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1460024248',owner_user_name='tempest-DeleteServersTestJSON-1460024248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:34Z,user_data=None,user_id='44ee4fd69fb1480d8b93941b8867ae52',uuid=9da5205c-ed07-4087-87b3-1c49f309154a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converting VIF {"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG os_vif [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Created schema index Interface.name {{(pid=72863) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Created schema index Port.name {{(pid=72863) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Created schema index Bridge.name {{(pid=72863) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [POLLOUT] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:22:43 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp6s1m9phl/privsep.sock']
Aug 15 13:22:43 user sudo[82214]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp6s1m9phl/privsep.sock
Aug 15 13:22:43 user sudo[82214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 13:22:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Successfully updated port: 2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Successfully updated port: 4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-changed-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Refreshing instance network info cache due to event network-changed-2b260b4c-bea8-4b7d-9131-0a938ed031e6. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updated VIF entry in instance network info cache for port 6082c7b7-5fa7-45e5-8d35-6761319d72d0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updating instance_info_cache with network_info: [{"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ee5381c-b2f0-4d6d-b395-1e80d2ac8e18 req-bd1dbdca-b756-43a0-86fd-3dc197327d98 service nova] Releasing lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-changed-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Refreshing instance network info cache due to event network-changed-4ff427ca-49ff-41ba-b2e8-99d9f437dce9. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] Acquiring lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:44 user sudo[82214]: pam_unix(sudo:session): session closed for user root
Aug 15 13:22:44 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Spawned new privsep daemon via rootwrap
Aug 15 13:22:44 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 13:22:44 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 13:22:44 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 13:22:44 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82218
Aug 15 13:22:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance network_info: |[{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Refreshing network info cache for port 2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start _get_guest_xml network_info=[{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:22:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:22:45 user nova-compute[72863]:   <uuid>86c46771-bc19-4440-9ed1-d713a003b231</uuid>
Aug 15 13:22:45 user nova-compute[72863]:   <name>instance-00000004</name>
Aug 15 13:22:45 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:22:45 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:22:45 user nova-compute[72863]:   <metadata>
Aug 15 13:22:45 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:22:45 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeTestJSON-server-1730461208</nova:name>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:22:45</nova:creationTime>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:22:45 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:22:45 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:owner>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:user uuid="acc0646305654477852de0c8bdebce90">tempest-AttachVolumeTestJSON-1527183200-project-member</nova:user>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:project uuid="974e84d7fd49440bb0449944cc4ffa94">tempest-AttachVolumeTestJSON-1527183200</nova:project>
Aug 15 13:22:45 user nova-compute[72863]:       </nova:owner>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:22:45 user nova-compute[72863]:       <nova:ports>
Aug 15 13:22:45 user nova-compute[72863]:         <nova:port uuid="2b260b4c-bea8-4b7d-9131-0a938ed031e6">
Aug 15 13:22:45 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:22:45 user nova-compute[72863]:         </nova:port>
Aug 15 13:22:45 user nova-compute[72863]:       </nova:ports>
Aug 15 13:22:45 user nova-compute[72863]:     </nova:instance>
Aug 15 13:22:45 user nova-compute[72863]:   </metadata>
Aug 15 13:22:45 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:22:45 user nova-compute[72863]:     <system>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="serial">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="uuid">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:22:45 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:22:45 user nova-compute[72863]:     </system>
Aug 15 13:22:45 user nova-compute[72863]:   </sysinfo>
Aug 15 13:22:45 user nova-compute[72863]:   <os>
Aug 15 13:22:45 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:22:45 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:22:45 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:22:45 user nova-compute[72863]:   </os>
Aug 15 13:22:45 user nova-compute[72863]:   <features>
Aug 15 13:22:45 user nova-compute[72863]:     <acpi/>
Aug 15 13:22:45 user nova-compute[72863]:     <apic/>
Aug 15 13:22:45 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:22:45 user nova-compute[72863]:   </features>
Aug 15 13:22:45 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:22:45 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:22:45 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:22:45 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:22:45 user nova-compute[72863]:   </clock>
Aug 15 13:22:45 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:22:45 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:22:45 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:22:45 user nova-compute[72863]:   </cpu>
Aug 15 13:22:45 user nova-compute[72863]:   <devices>
Aug 15 13:22:45 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:22:45 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:22:45 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk"/>
Aug 15 13:22:45 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:22:45 user nova-compute[72863]:     </disk>
Aug 15 13:22:45 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:22:45 user nova-compute[72863]:       <mac address="fa:16:3e:03:ed:b5"/>
Aug 15 13:22:45 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:45 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:22:45 user nova-compute[72863]:       <target dev="tap2b260b4c-be"/>
Aug 15 13:22:45 user nova-compute[72863]:     </interface>
Aug 15 13:22:45 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:22:45 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/console.log" append="off"/>
Aug 15 13:22:45 user nova-compute[72863]:     </serial>
Aug 15 13:22:45 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:22:45 user nova-compute[72863]:     <video>
Aug 15 13:22:45 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:45 user nova-compute[72863]:     </video>
Aug 15 13:22:45 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:22:45 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:22:45 user nova-compute[72863]:     </rng>
Aug 15 13:22:45 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:22:45 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:22:45 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:22:45 user nova-compute[72863]:     </memballoon>
Aug 15 13:22:45 user nova-compute[72863]:   </devices>
Aug 15 13:22:45 user nova-compute[72863]: </domain>
Aug 15 13:22:45 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG os_vif [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Successfully updated port: 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquired lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-changed-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Refreshing instance network info cache due to event network-changed-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] Acquiring lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6082c7b7-5f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6082c7b7-5f, col_values=(('external_ids', {'iface-id': '6082c7b7-5fa7-45e5-8d35-6761319d72d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:87:33', 'vm-uuid': '9da5205c-ed07-4087-87b3-1c49f309154a'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: INFO os_vif [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f')
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b260b4c-be, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b260b4c-be, col_values=(('external_ids', {'iface-id': '2b260b4c-bea8-4b7d-9131-0a938ed031e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ed:b5', 'vm-uuid': '86c46771-bc19-4440-9ed1-d713a003b231'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:45 user nova-compute[72863]: INFO os_vif [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] No VIF found with MAC fa:16:3e:af:87:33, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No VIF found with MAC fa:16:3e:03:ed:b5, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating instance_info_cache with network_info: [{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Releasing lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Instance network_info: |[{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] Acquired lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Refreshing network info cache for port 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Start _get_guest_xml network_info=[{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Instance network_info: |[{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] Acquired lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.neutron [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Refreshing network info cache for port 4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Start _get_guest_xml network_info=[{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187699649',display_name='tempest-AttachVolumeNegativeTest-server-187699649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187699649',id=3,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8lvuZhOrpfI+d9UYXSQulIgcyuvtXmyYpk+1tHxBQkMZEniDO3qADAcHc8uTk7jEUQwWD50axb0igZfxjy6g6lb19gJcTEs3qv1YQJVGaxAkddA6o67Udb7sM7P2xMww==',key_name='tempest-keypair-1360471551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-xigkicsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=8518b46b-8053-41e4-9c1f-9b4215965ddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:45 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'pci_devices' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:22:46 user nova-compute[72863]:   <uuid>8518b46b-8053-41e4-9c1f-9b4215965ddc</uuid>
Aug 15 13:22:46 user nova-compute[72863]:   <name>instance-00000003</name>
Aug 15 13:22:46 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:22:46 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:22:46 user nova-compute[72863]:   <metadata>
Aug 15 13:22:46 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:22:46 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeNegativeTest-server-187699649</nova:name>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:22:45</nova:creationTime>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:22:46 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:owner>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:user uuid="e68128a64baa4eb89f1454f94115ae1c">tempest-AttachVolumeNegativeTest-1688916020-project-member</nova:user>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:project uuid="67f776a79a5746ae840d47da420daedc">tempest-AttachVolumeNegativeTest-1688916020</nova:project>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:owner>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:ports>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:port uuid="4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01">
Aug 15 13:22:46 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:22:46 user nova-compute[72863]:         </nova:port>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:ports>
Aug 15 13:22:46 user nova-compute[72863]:     </nova:instance>
Aug 15 13:22:46 user nova-compute[72863]:   </metadata>
Aug 15 13:22:46 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:22:46 user nova-compute[72863]:     <system>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="serial">8518b46b-8053-41e4-9c1f-9b4215965ddc</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="uuid">8518b46b-8053-41e4-9c1f-9b4215965ddc</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:22:46 user nova-compute[72863]:     </system>
Aug 15 13:22:46 user nova-compute[72863]:   </sysinfo>
Aug 15 13:22:46 user nova-compute[72863]:   <os>
Aug 15 13:22:46 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:22:46 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:22:46 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:22:46 user nova-compute[72863]:   </os>
Aug 15 13:22:46 user nova-compute[72863]:   <features>
Aug 15 13:22:46 user nova-compute[72863]:     <acpi/>
Aug 15 13:22:46 user nova-compute[72863]:     <apic/>
Aug 15 13:22:46 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:22:46 user nova-compute[72863]:   </features>
Aug 15 13:22:46 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:22:46 user nova-compute[72863]:   </clock>
Aug 15 13:22:46 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:22:46 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:22:46 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:22:46 user nova-compute[72863]:   </cpu>
Aug 15 13:22:46 user nova-compute[72863]:   <devices>
Aug 15 13:22:46 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:22:46 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:22:46 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk"/>
Aug 15 13:22:46 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:     </disk>
Aug 15 13:22:46 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:22:46 user nova-compute[72863]:       <mac address="fa:16:3e:0c:62:32"/>
Aug 15 13:22:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:22:46 user nova-compute[72863]:       <target dev="tap4b2b3c24-f1"/>
Aug 15 13:22:46 user nova-compute[72863]:     </interface>
Aug 15 13:22:46 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:22:46 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/console.log" append="off"/>
Aug 15 13:22:46 user nova-compute[72863]:     </serial>
Aug 15 13:22:46 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:22:46 user nova-compute[72863]:     <video>
Aug 15 13:22:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:     </video>
Aug 15 13:22:46 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:22:46 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:22:46 user nova-compute[72863]:     </rng>
Aug 15 13:22:46 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:22:46 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:22:46 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:22:46 user nova-compute[72863]:     </memballoon>
Aug 15 13:22:46 user nova-compute[72863]:   </devices>
Aug 15 13:22:46 user nova-compute[72863]: </domain>
Aug 15 13:22:46 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187699649',display_name='tempest-AttachVolumeNegativeTest-server-187699649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187699649',id=3,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8lvuZhOrpfI+d9UYXSQulIgcyuvtXmyYpk+1tHxBQkMZEniDO3qADAcHc8uTk7jEUQwWD50axb0igZfxjy6g6lb19gJcTEs3qv1YQJVGaxAkddA6o67Udb7sM7P2xMww==',key_name='tempest-keypair-1360471551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-xigkicsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=8518b46b-8053-41e4-9c1f-9b4215965ddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG os_vif [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:22:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b2b3c24-f1, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b2b3c24-f1, col_values=(('external_ids', {'iface-id': '4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:62:32', 'vm-uuid': '8518b46b-8053-41e4-9c1f-9b4215965ddc'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-826603017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-826603017',id=2,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-ed39xesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:37Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=1a9cffc0-83f3-4b49-82ea-0ec0f88db18d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: INFO os_vif [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1')
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:22:46 user nova-compute[72863]:   <uuid>1a9cffc0-83f3-4b49-82ea-0ec0f88db18d</uuid>
Aug 15 13:22:46 user nova-compute[72863]:   <name>instance-00000002</name>
Aug 15 13:22:46 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:22:46 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:22:46 user nova-compute[72863]:   <metadata>
Aug 15 13:22:46 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:22:46 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-826603017</nova:name>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:22:46</nova:creationTime>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:22:46 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:owner>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:user uuid="f28612e758464797a56a4b7ea233ae66">tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member</nova:user>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:project uuid="03e9e6721b634d2fb974f7a10c6e0359">tempest-ServerBootFromVolumeStableRescueTest-603513238</nova:project>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:owner>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:22:46 user nova-compute[72863]:       <nova:ports>
Aug 15 13:22:46 user nova-compute[72863]:         <nova:port uuid="4ff427ca-49ff-41ba-b2e8-99d9f437dce9">
Aug 15 13:22:46 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 13:22:46 user nova-compute[72863]:         </nova:port>
Aug 15 13:22:46 user nova-compute[72863]:       </nova:ports>
Aug 15 13:22:46 user nova-compute[72863]:     </nova:instance>
Aug 15 13:22:46 user nova-compute[72863]:   </metadata>
Aug 15 13:22:46 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:22:46 user nova-compute[72863]:     <system>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="serial">1a9cffc0-83f3-4b49-82ea-0ec0f88db18d</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="uuid">1a9cffc0-83f3-4b49-82ea-0ec0f88db18d</entry>
Aug 15 13:22:46 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:22:46 user nova-compute[72863]:     </system>
Aug 15 13:22:46 user nova-compute[72863]:   </sysinfo>
Aug 15 13:22:46 user nova-compute[72863]:   <os>
Aug 15 13:22:46 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:22:46 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:22:46 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:22:46 user nova-compute[72863]:   </os>
Aug 15 13:22:46 user nova-compute[72863]:   <features>
Aug 15 13:22:46 user nova-compute[72863]:     <acpi/>
Aug 15 13:22:46 user nova-compute[72863]:     <apic/>
Aug 15 13:22:46 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:22:46 user nova-compute[72863]:   </features>
Aug 15 13:22:46 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:22:46 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:22:46 user nova-compute[72863]:   </clock>
Aug 15 13:22:46 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:22:46 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:22:46 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:22:46 user nova-compute[72863]:   </cpu>
Aug 15 13:22:46 user nova-compute[72863]:   <devices>
Aug 15 13:22:46 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:22:46 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:22:46 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk"/>
Aug 15 13:22:46 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:     </disk>
Aug 15 13:22:46 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:22:46 user nova-compute[72863]:       <mac address="fa:16:3e:d2:6d:19"/>
Aug 15 13:22:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:22:46 user nova-compute[72863]:       <target dev="tap4ff427ca-49"/>
Aug 15 13:22:46 user nova-compute[72863]:     </interface>
Aug 15 13:22:46 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:22:46 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/console.log" append="off"/>
Aug 15 13:22:46 user nova-compute[72863]:     </serial>
Aug 15 13:22:46 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:22:46 user nova-compute[72863]:     <video>
Aug 15 13:22:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:22:46 user nova-compute[72863]:     </video>
Aug 15 13:22:46 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:22:46 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:22:46 user nova-compute[72863]:     </rng>
Aug 15 13:22:46 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:22:46 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:22:46 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:22:46 user nova-compute[72863]:     </memballoon>
Aug 15 13:22:46 user nova-compute[72863]:   </devices>
Aug 15 13:22:46 user nova-compute[72863]: </domain>
Aug 15 13:22:46 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-826603017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-826603017',id=2,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-ed39xesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:37Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=1a9cffc0-83f3-4b49-82ea-0ec0f88db18d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG os_vif [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ff427ca-49, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ff427ca-49, col_values=(('external_ids', {'iface-id': '4ff427ca-49ff-41ba-b2e8-99d9f437dce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:6d:19', 'vm-uuid': '1a9cffc0-83f3-4b49-82ea-0ec0f88db18d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:0c:62:32, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: INFO os_vif [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49')
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No VIF found with MAC fa:16:3e:d2:6d:19, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updated VIF entry in instance network info cache for port 2b260b4c-bea8-4b7d-9131-0a938ed031e6. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-170376f7-19b2-4c8b-a433-443726630f8b req-3aaf6bc0-06c1-4eda-be2a-a127f37d86d3 service nova] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updated VIF entry in instance network info cache for port 4ff427ca-49ff-41ba-b2e8-99d9f437dce9. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91618c96-aa2d-49c9-8fc0-1dc3c0c63033 req-522be4dd-63fc-4c80-b5b9-3abe06f82381 service nova] Releasing lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updated VIF entry in instance network info cache for port 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating instance_info_cache with network_info: [{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-88f9e5c1-023d-4e45-b1cf-478eefb602f1 req-badeea05-37a5-4694-862e-ef2c0041f463 service nova] Releasing lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:22:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105772.918612, 9da5205c-ed07-4087-87b3-1c49f309154a => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:52 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] VM Resumed (Lifecycle Event)
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:22:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Instance spawned successfully.
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:52 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105772.928627, 9da5205c-ed07-4087-87b3-1c49f309154a => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] VM Started (Lifecycle Event)
Aug 15 13:22:53 user nova-compute[72863]: INFO nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Took 19.24 seconds to spawn the instance on the hypervisor.
Aug 15 13:22:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:53 user nova-compute[72863]: INFO nova.compute.manager [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Took 20.17 seconds to build instance.
Aug 15 13:22:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9576eb13-becc-4fcd-9154-6fd6b6e93cd0 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.390s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.0194523, 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] VM Resumed (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Instance spawned successfully.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance spawned successfully.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.020575, 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] VM Started (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Instance spawned successfully.
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Took 17.20 seconds to spawn the instance on the hypervisor.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Took 14.77 seconds to spawn the instance on the hypervisor.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.0268662, 86c46771-bc19-4440-9ed1-d713a003b231 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Resumed (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.026966, 86c46771-bc19-4440-9ed1-d713a003b231 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Started (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Took 18.17 seconds to build instance.
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Took 16.21 seconds to build instance.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.1888607, 8518b46b-8053-41e4-9c1f-9b4215965ddc => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] VM Resumed (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5753d83a-9f5d-4d83-83d1-55eaf9c9b07d tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.379s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-99cfbab4-37c6-4233-8f62-e35bdf3e9700 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.568s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Took 15.75 seconds to spawn the instance on the hypervisor.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105774.203301, 8518b46b-8053-41e4-9c1f-9b4215965ddc => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] VM Started (Lifecycle Event)
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:22:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:22:54 user nova-compute[72863]: INFO nova.compute.manager [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Took 16.66 seconds to build instance.
Aug 15 13:22:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c3216322-377e-45d2-81d1-bfad18ab24c1 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.842s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:22:57 user nova-compute[72863]: INFO nova.compute.claims [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Claim successful on node user
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:22:58 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] No waiting events found dispatching network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:22:58 user nova-compute[72863]: WARNING nova.compute.manager [req-b9c8e8b6-4228-464b-97be-e8e574ab8047 req-5921a223-74f9-4711-b607-ec93e099c9c4 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received unexpected event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 for instance with vm_state active and task_state None.
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.policy [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd81e75837b643a88dfd40c25402334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323ea5da06254ef4b04d4dc14f6e474a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:22:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:22:59 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Creating image(s)
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.part --force-share --output=json" returned: 0 in 0.259s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG nova.virt.images [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] 86b907c3-8fe3-4b0d-b216-dcca8045e60c was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:22:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.part /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.part /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.converted" returned: 0 in 0.445s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.704s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] No waiting events found dispatching network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:00 user nova-compute[72863]: WARNING nova.compute.manager [req-58eff510-5408-44ce-a82a-4e043ec23164 req-d09f3b0f-4aa4-4feb-89ef-e92038d6b100 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received unexpected event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 for instance with vm_state active and task_state None.
Aug 15 13:23:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json" returned: 0 in 0.276s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Successfully created port: f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json" returned: 0 in 0.329s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca,backing_fmt=raw /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca,backing_fmt=raw /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk 1073741824" returned: 0 in 0.162s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "0398fb277e1dc8a418d7880b6ee65f332aa7fbca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.499s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca --force-share --output=json" returned: 0 in 0.252s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Cannot resize image /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG nova.objects.instance [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'migration_context' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Ensure instance console log exists: /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Successfully updated port: f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquired lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-changed-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Refreshing instance network info cache due to event network-changed-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] Acquiring lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:23:03 user nova-compute[72863]: INFO nova.compute.claims [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Claim successful on node user
Aug 15 13:23:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updating instance_info_cache with network_info: [{"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Releasing lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Instance network_info: |[{"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] Acquired lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Refreshing network info cache for port f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Start _get_guest_xml network_info=[{"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:22:48Z,direct_url=<?>,disk_format='qcow2',id=86b907c3-8fe3-4b0d-b216-dcca8045e60c,min_disk=0,min_ram=0,name='',owner='6bf3ea97ae5f4ed7a3f2186fdf5fb427',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:22:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'image_id': '86b907c3-8fe3-4b0d-b216-dcca8045e60c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:23:04 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:04 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:22:48Z,direct_url=<?>,disk_format='qcow2',id=86b907c3-8fe3-4b0d-b216-dcca8045e60c,min_disk=0,min_ram=0,name='',owner='6bf3ea97ae5f4ed7a3f2186fdf5fb427',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:22:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-413236999',display_name='tempest-AttachSCSIVolumeTestJSON-server-413236999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-413236999',id=5,image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZZhT7s6iiR++1X/elxodUTKnH5220R24huCfcvLC3GkLJKA4sYmewntiZxva1AXza4w35udWmrzxruWQObU/VKEBH0UgNAj4Q/9ag/fdub6/RILfKqS5adF94Ozv+RA==',key_name='tempest-keypair-1103316038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='323ea5da06254ef4b04d4dc14f6e474a',ramdisk_id='',reservation_id='r-brmne2ua',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1377483256',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1377483256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd81e75837b643a88dfd40c25402334e',uuid=f48d3dd5-fb94-4688-bbbb-375136f04c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converting VIF {"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.objects.instance [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'pci_devices' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:23:04 user nova-compute[72863]:   <uuid>f48d3dd5-fb94-4688-bbbb-375136f04c76</uuid>
Aug 15 13:23:04 user nova-compute[72863]:   <name>instance-00000005</name>
Aug 15 13:23:04 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:23:04 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:23:04 user nova-compute[72863]:   <metadata>
Aug 15 13:23:04 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:23:04 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-413236999</nova:name>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:23:04</nova:creationTime>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:23:04 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:23:04 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:owner>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:user uuid="cd81e75837b643a88dfd40c25402334e">tempest-AttachSCSIVolumeTestJSON-1377483256-project-member</nova:user>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:project uuid="323ea5da06254ef4b04d4dc14f6e474a">tempest-AttachSCSIVolumeTestJSON-1377483256</nova:project>
Aug 15 13:23:04 user nova-compute[72863]:       </nova:owner>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:root type="image" uuid="86b907c3-8fe3-4b0d-b216-dcca8045e60c"/>
Aug 15 13:23:04 user nova-compute[72863]:       <nova:ports>
Aug 15 13:23:04 user nova-compute[72863]:         <nova:port uuid="f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773">
Aug 15 13:23:04 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:23:04 user nova-compute[72863]:         </nova:port>
Aug 15 13:23:04 user nova-compute[72863]:       </nova:ports>
Aug 15 13:23:04 user nova-compute[72863]:     </nova:instance>
Aug 15 13:23:04 user nova-compute[72863]:   </metadata>
Aug 15 13:23:04 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:23:04 user nova-compute[72863]:     <system>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="serial">f48d3dd5-fb94-4688-bbbb-375136f04c76</entry>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="uuid">f48d3dd5-fb94-4688-bbbb-375136f04c76</entry>
Aug 15 13:23:04 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:23:04 user nova-compute[72863]:     </system>
Aug 15 13:23:04 user nova-compute[72863]:   </sysinfo>
Aug 15 13:23:04 user nova-compute[72863]:   <os>
Aug 15 13:23:04 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:23:04 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:23:04 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:23:04 user nova-compute[72863]:   </os>
Aug 15 13:23:04 user nova-compute[72863]:   <features>
Aug 15 13:23:04 user nova-compute[72863]:     <acpi/>
Aug 15 13:23:04 user nova-compute[72863]:     <apic/>
Aug 15 13:23:04 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:23:04 user nova-compute[72863]:   </features>
Aug 15 13:23:04 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:23:04 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:23:04 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:23:04 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:23:04 user nova-compute[72863]:   </clock>
Aug 15 13:23:04 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:23:04 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:23:04 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:23:04 user nova-compute[72863]:   </cpu>
Aug 15 13:23:04 user nova-compute[72863]:   <devices>
Aug 15 13:23:04 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:23:04 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:23:04 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk"/>
Aug 15 13:23:04 user nova-compute[72863]:       <target dev="sda" bus="scsi"/>
Aug 15 13:23:04 user nova-compute[72863]:       <address type="drive" controller="0" unit="0"/>
Aug 15 13:23:04 user nova-compute[72863]:     </disk>
Aug 15 13:23:04 user nova-compute[72863]:     <disk type="file" device="cdrom">
Aug 15 13:23:04 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 13:23:04 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.config"/>
Aug 15 13:23:04 user nova-compute[72863]:       <target dev="sdb" bus="scsi"/>
Aug 15 13:23:04 user nova-compute[72863]:       <address type="drive" controller="0" unit="1"/>
Aug 15 13:23:04 user nova-compute[72863]:     </disk>
Aug 15 13:23:04 user nova-compute[72863]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 13:23:04 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:23:04 user nova-compute[72863]:       <mac address="fa:16:3e:7f:5f:ab"/>
Aug 15 13:23:04 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:04 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:23:04 user nova-compute[72863]:       <target dev="tapf3ab38b6-a2"/>
Aug 15 13:23:04 user nova-compute[72863]:     </interface>
Aug 15 13:23:04 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:23:04 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/console.log" append="off"/>
Aug 15 13:23:04 user nova-compute[72863]:     </serial>
Aug 15 13:23:04 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:23:04 user nova-compute[72863]:     <video>
Aug 15 13:23:04 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:04 user nova-compute[72863]:     </video>
Aug 15 13:23:04 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:23:04 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:23:04 user nova-compute[72863]:     </rng>
Aug 15 13:23:04 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:23:04 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:23:04 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:23:04 user nova-compute[72863]:     </memballoon>
Aug 15 13:23:04 user nova-compute[72863]:   </devices>
Aug 15 13:23:04 user nova-compute[72863]: </domain>
Aug 15 13:23:04 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-413236999',display_name='tempest-AttachSCSIVolumeTestJSON-server-413236999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-413236999',id=5,image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZZhT7s6iiR++1X/elxodUTKnH5220R24huCfcvLC3GkLJKA4sYmewntiZxva1AXza4w35udWmrzxruWQObU/VKEBH0UgNAj4Q/9ag/fdub6/RILfKqS5adF94Ozv+RA==',key_name='tempest-keypair-1103316038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='323ea5da06254ef4b04d4dc14f6e474a',ramdisk_id='',reservation_id='r-brmne2ua',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1377483256',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1377483256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd81e75837b643a88dfd40c25402334e',uuid=f48d3dd5-fb94-4688-bbbb-375136f04c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converting VIF {"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG os_vif [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3ab38b6-a2, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3ab38b6-a2, col_values=(('external_ids', {'iface-id': 'f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:5f:ab', 'vm-uuid': 'f48d3dd5-fb94-4688-bbbb-375136f04c76'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:04 user nova-compute[72863]: INFO os_vif [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2')
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.885s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No BDM found with device name sda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No VIF found with MAC fa:16:3e:7f:5f:ab, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:23:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Using config drive
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:23:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:23:04 user nova-compute[72863]: INFO nova.compute.claims [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Claim successful on node user
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.policy [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0de57a132def47359f74cad70c1b2a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c077f561bb445aa9a3a35d2f677f0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updated VIF entry in instance network info cache for port f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updating instance_info_cache with network_info: [{"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:23:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Creating image(s)
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "/opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "/opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0ab084c-e44a-4e98-b6a7-7ed050a3b1df req-7846435d-d1f5-4d12-a87d-95cebff40fd8 service nova] Releasing lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Creating config drive at /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.config
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx28rhisz {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.282s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx28rhisz" returned: 0 in 0.102s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.286s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk 1073741824" returned: 0 in 0.096s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Successfully created port: 50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.881s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:23:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.249s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.policy [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f4ef24e638d4b9eaae290fdcf7f33b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3694f35a64b419c7ada9fc75fea32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:23:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Cannot resize image /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'migration_context' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Ensure instance console log exists: /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:23:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Creating image(s)
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "/opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "/opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.246s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.227s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk 1073741824" returned: 0 in 0.083s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Successfully updated port: 50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.306s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquired lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-changed-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Refreshing instance network info cache due to event network-changed-50226385-bc9c-488b-9070-201b266392bf. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] Acquiring lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Successfully created port: 960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Cannot resize image /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lazy-loading 'migration_context' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Ensure instance console log exists: /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating instance_info_cache with network_info: [{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Releasing lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Instance network_info: |[{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] Acquired lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Refreshing network info cache for port 50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Start _get_guest_xml network_info=[{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:23:08 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:08 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1704285328',display_name='tempest-VolumesAdminNegativeTest-server-1704285328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1704285328',id=6,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVehoWQp8Pgzot3PWmrpbJevnZ974U7ZlrUXA5FMu7mwu+wqXlTC8EWildq5eTUul4XBAYrei/b+rjEst2O5gnYgv3584X4KwuacGkP+2d3KrspH8xZBzr0BS9LYkUd+Q==',key_name='tempest-keypair-1093074584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-8bgkkzk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0de57a132def47359f74cad70c1b2a4f',uuid=fcac4ae5-a862-496e-b30f-b4c73bcc3368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'pci_devices' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:23:08 user nova-compute[72863]:   <uuid>fcac4ae5-a862-496e-b30f-b4c73bcc3368</uuid>
Aug 15 13:23:08 user nova-compute[72863]:   <name>instance-00000006</name>
Aug 15 13:23:08 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:23:08 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:23:08 user nova-compute[72863]:   <metadata>
Aug 15 13:23:08 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:23:08 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1704285328</nova:name>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:23:08</nova:creationTime>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:23:08 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:23:08 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:owner>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:user uuid="0de57a132def47359f74cad70c1b2a4f">tempest-VolumesAdminNegativeTest-890931694-project-member</nova:user>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:project uuid="5c077f561bb445aa9a3a35d2f677f0d0">tempest-VolumesAdminNegativeTest-890931694</nova:project>
Aug 15 13:23:08 user nova-compute[72863]:       </nova:owner>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:23:08 user nova-compute[72863]:       <nova:ports>
Aug 15 13:23:08 user nova-compute[72863]:         <nova:port uuid="50226385-bc9c-488b-9070-201b266392bf">
Aug 15 13:23:08 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:23:08 user nova-compute[72863]:         </nova:port>
Aug 15 13:23:08 user nova-compute[72863]:       </nova:ports>
Aug 15 13:23:08 user nova-compute[72863]:     </nova:instance>
Aug 15 13:23:08 user nova-compute[72863]:   </metadata>
Aug 15 13:23:08 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:23:08 user nova-compute[72863]:     <system>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="serial">fcac4ae5-a862-496e-b30f-b4c73bcc3368</entry>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="uuid">fcac4ae5-a862-496e-b30f-b4c73bcc3368</entry>
Aug 15 13:23:08 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:23:08 user nova-compute[72863]:     </system>
Aug 15 13:23:08 user nova-compute[72863]:   </sysinfo>
Aug 15 13:23:08 user nova-compute[72863]:   <os>
Aug 15 13:23:08 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:23:08 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:23:08 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:23:08 user nova-compute[72863]:   </os>
Aug 15 13:23:08 user nova-compute[72863]:   <features>
Aug 15 13:23:08 user nova-compute[72863]:     <acpi/>
Aug 15 13:23:08 user nova-compute[72863]:     <apic/>
Aug 15 13:23:08 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:23:08 user nova-compute[72863]:   </features>
Aug 15 13:23:08 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:23:08 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:23:08 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:23:08 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:23:08 user nova-compute[72863]:   </clock>
Aug 15 13:23:08 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:23:08 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:23:08 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:23:08 user nova-compute[72863]:   </cpu>
Aug 15 13:23:08 user nova-compute[72863]:   <devices>
Aug 15 13:23:08 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:23:08 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:23:08 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk"/>
Aug 15 13:23:08 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:23:08 user nova-compute[72863]:     </disk>
Aug 15 13:23:08 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:23:08 user nova-compute[72863]:       <mac address="fa:16:3e:6b:ca:51"/>
Aug 15 13:23:08 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:08 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:23:08 user nova-compute[72863]:       <target dev="tap50226385-bc"/>
Aug 15 13:23:08 user nova-compute[72863]:     </interface>
Aug 15 13:23:08 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:23:08 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/console.log" append="off"/>
Aug 15 13:23:08 user nova-compute[72863]:     </serial>
Aug 15 13:23:08 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:23:08 user nova-compute[72863]:     <video>
Aug 15 13:23:08 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:08 user nova-compute[72863]:     </video>
Aug 15 13:23:08 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:23:08 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:23:08 user nova-compute[72863]:     </rng>
Aug 15 13:23:08 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:23:08 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:23:08 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:23:08 user nova-compute[72863]:     </memballoon>
Aug 15 13:23:08 user nova-compute[72863]:   </devices>
Aug 15 13:23:08 user nova-compute[72863]: </domain>
Aug 15 13:23:08 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1704285328',display_name='tempest-VolumesAdminNegativeTest-server-1704285328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1704285328',id=6,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVehoWQp8Pgzot3PWmrpbJevnZ974U7ZlrUXA5FMu7mwu+wqXlTC8EWildq5eTUul4XBAYrei/b+rjEst2O5gnYgv3584X4KwuacGkP+2d3KrspH8xZBzr0BS9LYkUd+Q==',key_name='tempest-keypair-1093074584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-8bgkkzk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0de57a132def47359f74cad70c1b2a4f',uuid=fcac4ae5-a862-496e-b30f-b4c73bcc3368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG os_vif [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50226385-bc, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50226385-bc, col_values=(('external_ids', {'iface-id': '50226385-bc9c-488b-9070-201b266392bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ca:51', 'vm-uuid': 'fcac4ae5-a862-496e-b30f-b4c73bcc3368'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:23:08 user nova-compute[72863]: INFO os_vif [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc')
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No VIF found with MAC fa:16:3e:6b:ca:51, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Successfully updated port: 960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquired lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-changed-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Refreshing instance network info cache due to event network-changed-960d42e1-6975-4b57-832a-046fd3d3ecb0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] Acquiring lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updating instance_info_cache with network_info: [{"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Releasing lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Instance network_info: |[{"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] Acquired lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Refreshing network info cache for port 960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Start _get_guest_xml network_info=[{"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updated VIF entry in instance network info cache for port 50226385-bc9c-488b-9070-201b266392bf. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating instance_info_cache with network_info: [{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:09 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:09 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-366986408',display_name='tempest-VolumesAssistedSnapshotsTest-server-366986408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-366986408',id=7,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVoxwJ0XWa9t/xHZAzHaoAeSMFa0rn3Z6ZAnJSzVHth5KST//WBgw8f6ONk/ZRIUOpOk4yxLoFSZ1CI5oSrnoar5btGPzPCmCrl0QBKLkvbAuN14O7xFX3FHM1CgHQuhA==',key_name='tempest-keypair-1476727890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ae3694f35a64b419c7ada9fc75fea32',ramdisk_id='',reservation_id='r-2jrgvuip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1567405456',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1567405456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f4ef24e638d4b9eaae290fdcf7f33b2',uuid=b33fd6c7-9e23-436a-858c-2767f8baf885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converting VIF {"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lazy-loading 'pci_devices' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-236fe515-4b86-429b-a90d-55e60af5cc58 req-73101fb4-ca4b-4408-807e-b56e760c6796 service nova] Releasing lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:23:09 user nova-compute[72863]:   <uuid>b33fd6c7-9e23-436a-858c-2767f8baf885</uuid>
Aug 15 13:23:09 user nova-compute[72863]:   <name>instance-00000007</name>
Aug 15 13:23:09 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:23:09 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:23:09 user nova-compute[72863]:   <metadata>
Aug 15 13:23:09 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:23:09 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-366986408</nova:name>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:23:09</nova:creationTime>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:23:09 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:23:09 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:owner>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:user uuid="4f4ef24e638d4b9eaae290fdcf7f33b2">tempest-VolumesAssistedSnapshotsTest-1567405456-project-member</nova:user>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:project uuid="6ae3694f35a64b419c7ada9fc75fea32">tempest-VolumesAssistedSnapshotsTest-1567405456</nova:project>
Aug 15 13:23:09 user nova-compute[72863]:       </nova:owner>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:23:09 user nova-compute[72863]:       <nova:ports>
Aug 15 13:23:09 user nova-compute[72863]:         <nova:port uuid="960d42e1-6975-4b57-832a-046fd3d3ecb0">
Aug 15 13:23:09 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:23:09 user nova-compute[72863]:         </nova:port>
Aug 15 13:23:09 user nova-compute[72863]:       </nova:ports>
Aug 15 13:23:09 user nova-compute[72863]:     </nova:instance>
Aug 15 13:23:09 user nova-compute[72863]:   </metadata>
Aug 15 13:23:09 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:23:09 user nova-compute[72863]:     <system>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="serial">b33fd6c7-9e23-436a-858c-2767f8baf885</entry>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="uuid">b33fd6c7-9e23-436a-858c-2767f8baf885</entry>
Aug 15 13:23:09 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:23:09 user nova-compute[72863]:     </system>
Aug 15 13:23:09 user nova-compute[72863]:   </sysinfo>
Aug 15 13:23:09 user nova-compute[72863]:   <os>
Aug 15 13:23:09 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:23:09 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:23:09 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:23:09 user nova-compute[72863]:   </os>
Aug 15 13:23:09 user nova-compute[72863]:   <features>
Aug 15 13:23:09 user nova-compute[72863]:     <acpi/>
Aug 15 13:23:09 user nova-compute[72863]:     <apic/>
Aug 15 13:23:09 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:23:09 user nova-compute[72863]:   </features>
Aug 15 13:23:09 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:23:09 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:23:09 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:23:09 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:23:09 user nova-compute[72863]:   </clock>
Aug 15 13:23:09 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:23:09 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:23:09 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:23:09 user nova-compute[72863]:   </cpu>
Aug 15 13:23:09 user nova-compute[72863]:   <devices>
Aug 15 13:23:09 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:23:09 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:23:09 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk"/>
Aug 15 13:23:09 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:23:09 user nova-compute[72863]:     </disk>
Aug 15 13:23:09 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:23:09 user nova-compute[72863]:       <mac address="fa:16:3e:48:cc:6b"/>
Aug 15 13:23:09 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:09 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:23:09 user nova-compute[72863]:       <target dev="tap960d42e1-69"/>
Aug 15 13:23:09 user nova-compute[72863]:     </interface>
Aug 15 13:23:09 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:23:09 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/console.log" append="off"/>
Aug 15 13:23:09 user nova-compute[72863]:     </serial>
Aug 15 13:23:09 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:23:09 user nova-compute[72863]:     <video>
Aug 15 13:23:09 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:09 user nova-compute[72863]:     </video>
Aug 15 13:23:09 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:23:09 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:23:09 user nova-compute[72863]:     </rng>
Aug 15 13:23:09 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:23:09 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:23:09 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:23:09 user nova-compute[72863]:     </memballoon>
Aug 15 13:23:09 user nova-compute[72863]:   </devices>
Aug 15 13:23:09 user nova-compute[72863]: </domain>
Aug 15 13:23:09 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-366986408',display_name='tempest-VolumesAssistedSnapshotsTest-server-366986408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-366986408',id=7,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVoxwJ0XWa9t/xHZAzHaoAeSMFa0rn3Z6ZAnJSzVHth5KST//WBgw8f6ONk/ZRIUOpOk4yxLoFSZ1CI5oSrnoar5btGPzPCmCrl0QBKLkvbAuN14O7xFX3FHM1CgHQuhA==',key_name='tempest-keypair-1476727890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ae3694f35a64b419c7ada9fc75fea32',ramdisk_id='',reservation_id='r-2jrgvuip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1567405456',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1567405456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f4ef24e638d4b9eaae290fdcf7f33b2',uuid=b33fd6c7-9e23-436a-858c-2767f8baf885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converting VIF {"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG os_vif [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap960d42e1-69, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap960d42e1-69, col_values=(('external_ids', {'iface-id': '960d42e1-6975-4b57-832a-046fd3d3ecb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:cc:6b', 'vm-uuid': 'b33fd6c7-9e23-436a-858c-2767f8baf885'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:09 user nova-compute[72863]: INFO os_vif [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69')
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] No VIF found with MAC fa:16:3e:48:cc:6b, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105790.1433663, f48d3dd5-fb94-4688-bbbb-375136f04c76 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] VM Resumed (Lifecycle Event)
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Instance spawned successfully.
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105790.1442738, f48d3dd5-fb94-4688-bbbb-375136f04c76 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] VM Started (Lifecycle Event)
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Took 11.48 seconds to spawn the instance on the hypervisor.
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updated VIF entry in instance network info cache for port 960d42e1-6975-4b57-832a-046fd3d3ecb0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updating instance_info_cache with network_info: [{"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aaa2ba80-ec82-4723-96c8-ca2769a88f06 req-6dd33ed1-f046-4915-929d-e148b6b9c491 service nova] Releasing lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:10 user nova-compute[72863]: INFO nova.compute.manager [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Took 12.98 seconds to build instance.
Aug 15 13:23:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7b986f6-c75d-430b-9b26-e885e4eb708f tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.206s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] No waiting events found dispatching network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:11 user nova-compute[72863]: WARNING nova.compute.manager [req-7515f18d-d02e-4758-b00b-8f3b3155834c req-a459ee9d-cfff-4187-a308-f5a9fa731018 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received unexpected event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf for instance with vm_state building and task_state spawning.
Aug 15 13:23:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] No waiting events found dispatching network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:13 user nova-compute[72863]: WARNING nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received unexpected event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf for instance with vm_state building and task_state spawning.
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] No waiting events found dispatching network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:13 user nova-compute[72863]: WARNING nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received unexpected event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 for instance with vm_state building and task_state spawning.
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] No waiting events found dispatching network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:13 user nova-compute[72863]: WARNING nova.compute.manager [req-41056c93-c4cc-4b49-a28c-812a3753103d req-ad43d8ac-c431-453f-90e9-5cc8212bf3b9 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received unexpected event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 for instance with vm_state building and task_state spawning.
Aug 15 13:23:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] No waiting events found dispatching network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:13 user nova-compute[72863]: WARNING nova.compute.manager [req-05729f82-df74-4b9e-833d-43e688ad63a7 req-9819672f-f121-4a6d-9a74-c06b119ee869 service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received unexpected event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 for instance with vm_state active and task_state None.
Aug 15 13:23:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:23:14 user nova-compute[72863]: INFO nova.compute.claims [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Claim successful on node user
Aug 15 13:23:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:23:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:23:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.policy [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8782f0b0aad4918835dd1795f50aa6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f4a984fb814da6aad384e7595851ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Creating image(s)
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "/opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "/opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "/opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.227s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105795.4482133, b33fd6c7-9e23-436a-858c-2767f8baf885 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] VM Resumed (Lifecycle Event)
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Instance spawned successfully.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Instance spawned successfully.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk 1073741824" returned: 0 in 0.140s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105795.4496477, b33fd6c7-9e23-436a-858c-2767f8baf885 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] VM Started (Lifecycle Event)
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Took 9.65 seconds to spawn the instance on the hypervisor.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Successfully created port: 054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105795.478326, fcac4ae5-a862-496e-b30f-b4c73bcc3368 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] VM Resumed (Lifecycle Event)
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Took 11.00 seconds to spawn the instance on the hypervisor.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105795.4872887, fcac4ae5-a862-496e-b30f-b4c73bcc3368 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] VM Started (Lifecycle Event)
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:16 user nova-compute[72863]: INFO nova.compute.manager [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Took 11.29 seconds to build instance.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:16 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6dab7a6f-e881-4912-8e90-e0f1d12c7d6a tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.497s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] No waiting events found dispatching network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:16 user nova-compute[72863]: WARNING nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received unexpected event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 for instance with vm_state active and task_state None.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] No waiting events found dispatching network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:16 user nova-compute[72863]: WARNING nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received unexpected event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 for instance with vm_state active and task_state None.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] No waiting events found dispatching network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:16 user nova-compute[72863]: WARNING nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received unexpected event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 for instance with vm_state active and task_state None.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:16 user nova-compute[72863]: WARNING nova.compute.manager [req-7e114fa4-e402-4463-be2c-eb8e1ee98dc1 req-f667a9b4-7e75-4498-ae8c-66f0da9f00ec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state active and task_state None.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Cannot resize image /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'migration_context' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: INFO nova.compute.manager [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Took 12.51 seconds to build instance.
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d00ad3db-185c-421d-b9eb-d01857532434 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.687s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Successfully updated port: 054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquired lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-changed-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Refreshing instance network info cache due to event network-changed-054d7665-62e7-4bac-9741-1917b3e1c35d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] Acquiring lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] No waiting events found dispatching network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:17 user nova-compute[72863]: WARNING nova.compute.manager [req-260dcabd-cac9-40c5-b98f-e8bee6eea774 req-08cd90a3-b24a-4932-9d1b-dbd8cf439e0d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received unexpected event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 for instance with vm_state active and task_state None.
Aug 15 13:23:17 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:17 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=26.021800994873047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updating instance_info_cache with network_info: [{"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Releasing lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Instance network_info: |[{"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] Acquired lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Refreshing network info cache for port 054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Start _get_guest_xml network_info=[{"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:23:17 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:17 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:23:17 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1600720426',display_name='tempest-TestVolumeSwap-server-1600720426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1600720426',id=8,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN/u0hXwzPltgYk4Sze7AlhsCeolND2KznNFTWm7jmRmKWWkucSusLQZan7uElyDm30mH4XnsYcBm/7wLwI+yWhuUmUQKMHbNxpKOZgiW8gF4VhGQId3BFXBm6nwDKf2A==',key_name='tempest-keypair-329291675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f4a984fb814da6aad384e7595851ea',ramdisk_id='',reservation_id='r-htdnbxqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1715847175',owner_user_name='tempest-TestVolumeSwap-1715847175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8782f0b0aad4918835dd1795f50aa6c',uuid=72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converting VIF {"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'pci_devices' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9da5205c-ed07-4087-87b3-1c49f309154a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f48d3dd5-fb94-4688-bbbb-375136f04c76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b33fd6c7-9e23-436a-858c-2767f8baf885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:23:18 user nova-compute[72863]:   <uuid>72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d</uuid>
Aug 15 13:23:18 user nova-compute[72863]:   <name>instance-00000008</name>
Aug 15 13:23:18 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:23:18 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:23:18 user nova-compute[72863]:   <metadata>
Aug 15 13:23:18 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:23:18 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:name>tempest-TestVolumeSwap-server-1600720426</nova:name>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:23:17</nova:creationTime>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:23:18 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:23:18 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:owner>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:user uuid="a8782f0b0aad4918835dd1795f50aa6c">tempest-TestVolumeSwap-1715847175-project-member</nova:user>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:project uuid="61f4a984fb814da6aad384e7595851ea">tempest-TestVolumeSwap-1715847175</nova:project>
Aug 15 13:23:18 user nova-compute[72863]:       </nova:owner>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:23:18 user nova-compute[72863]:       <nova:ports>
Aug 15 13:23:18 user nova-compute[72863]:         <nova:port uuid="054d7665-62e7-4bac-9741-1917b3e1c35d">
Aug 15 13:23:18 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 13:23:18 user nova-compute[72863]:         </nova:port>
Aug 15 13:23:18 user nova-compute[72863]:       </nova:ports>
Aug 15 13:23:18 user nova-compute[72863]:     </nova:instance>
Aug 15 13:23:18 user nova-compute[72863]:   </metadata>
Aug 15 13:23:18 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:23:18 user nova-compute[72863]:     <system>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="serial">72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d</entry>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="uuid">72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d</entry>
Aug 15 13:23:18 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:23:18 user nova-compute[72863]:     </system>
Aug 15 13:23:18 user nova-compute[72863]:   </sysinfo>
Aug 15 13:23:18 user nova-compute[72863]:   <os>
Aug 15 13:23:18 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:23:18 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:23:18 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:23:18 user nova-compute[72863]:   </os>
Aug 15 13:23:18 user nova-compute[72863]:   <features>
Aug 15 13:23:18 user nova-compute[72863]:     <acpi/>
Aug 15 13:23:18 user nova-compute[72863]:     <apic/>
Aug 15 13:23:18 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:23:18 user nova-compute[72863]:   </features>
Aug 15 13:23:18 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:23:18 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:23:18 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:23:18 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:23:18 user nova-compute[72863]:   </clock>
Aug 15 13:23:18 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:23:18 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:23:18 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:23:18 user nova-compute[72863]:   </cpu>
Aug 15 13:23:18 user nova-compute[72863]:   <devices>
Aug 15 13:23:18 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:23:18 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:23:18 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk"/>
Aug 15 13:23:18 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:23:18 user nova-compute[72863]:     </disk>
Aug 15 13:23:18 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:23:18 user nova-compute[72863]:       <mac address="fa:16:3e:85:74:4d"/>
Aug 15 13:23:18 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:18 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:23:18 user nova-compute[72863]:       <target dev="tap054d7665-62"/>
Aug 15 13:23:18 user nova-compute[72863]:     </interface>
Aug 15 13:23:18 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:23:18 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/console.log" append="off"/>
Aug 15 13:23:18 user nova-compute[72863]:     </serial>
Aug 15 13:23:18 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:23:18 user nova-compute[72863]:     <video>
Aug 15 13:23:18 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:18 user nova-compute[72863]:     </video>
Aug 15 13:23:18 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:23:18 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:23:18 user nova-compute[72863]:     </rng>
Aug 15 13:23:18 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:23:18 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:23:18 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:23:18 user nova-compute[72863]:     </memballoon>
Aug 15 13:23:18 user nova-compute[72863]:   </devices>
Aug 15 13:23:18 user nova-compute[72863]: </domain>
Aug 15 13:23:18 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1600720426',display_name='tempest-TestVolumeSwap-server-1600720426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1600720426',id=8,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN/u0hXwzPltgYk4Sze7AlhsCeolND2KznNFTWm7jmRmKWWkucSusLQZan7uElyDm30mH4XnsYcBm/7wLwI+yWhuUmUQKMHbNxpKOZgiW8gF4VhGQId3BFXBm6nwDKf2A==',key_name='tempest-keypair-329291675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61f4a984fb814da6aad384e7595851ea',ramdisk_id='',reservation_id='r-htdnbxqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1715847175',owner_user_name='tempest-TestVolumeSwap-1715847175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8782f0b0aad4918835dd1795f50aa6c',uuid=72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converting VIF {"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG os_vif [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap054d7665-62, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap054d7665-62, col_values=(('external_ids', {'iface-id': '054d7665-62e7-4bac-9741-1917b3e1c35d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:74:4d', 'vm-uuid': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:18 user nova-compute[72863]: INFO os_vif [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62')
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:18 user nova-compute[72863]: WARNING nova.compute.manager [req-39fe8d22-5b19-46cc-9362-83dd4361f859 req-a82f9401-522f-41b7-b1c1-757e5a1cc212 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state active and task_state None.
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] No VIF found with MAC fa:16:3e:85:74:4d, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updated VIF entry in instance network info cache for port 054d7665-62e7-4bac-9741-1917b3e1c35d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updating instance_info_cache with network_info: [{"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22519993-a3fd-46da-8086-17ab9ac3c61b req-8ab5c5d1-8962-4781-8ccb-921419b0096f service nova] Releasing lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] No waiting events found dispatching network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:19 user nova-compute[72863]: WARNING nova.compute.manager [req-a3be6d4c-b37d-4de1-b215-1b0dce983b14 req-8e7ee682-c1e0-4bf2-a13c-874d2c87ead2 service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received unexpected event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 for instance with vm_state active and task_state None.
Aug 15 13:23:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Skipping network cache update for instance because it is Building. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updating instance_info_cache with network_info: [{"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-9da5205c-ed07-4087-87b3-1c49f309154a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] No waiting events found dispatching network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:21 user nova-compute[72863]: WARNING nova.compute.manager [req-14c6b5c0-5e89-45c2-9f2d-741117c8dcc6 req-330a2965-499b-4c34-b755-2ced953f9498 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received unexpected event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d for instance with vm_state building and task_state spawning.
Aug 15 13:23:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105803.1125238, 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] VM Resumed (Lifecycle Event)
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Instance spawned successfully.
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105803.1159387, 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] VM Started (Lifecycle Event)
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Took 8.28 seconds to spawn the instance on the hypervisor.
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:23 user nova-compute[72863]: INFO nova.compute.manager [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Took 9.35 seconds to build instance.
Aug 15 13:23:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4f80c1a6-3e0c-476b-b45c-477803180ad8 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.561s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] No waiting events found dispatching network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:23 user nova-compute[72863]: WARNING nova.compute.manager [req-535abb81-3c00-4c20-acdc-197e7ff08561 req-0168f51b-15a4-4845-a942-406ee23e9804 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received unexpected event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d for instance with vm_state active and task_state None.
Aug 15 13:23:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:23:34 user nova-compute[72863]: INFO nova.compute.claims [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Claim successful on node user
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:23:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.policy [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca72a24784cd40f09c6123c19ab19943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79baf779b6b8403d98a284fccb6d7ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:23:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Creating image(s)
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "/opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "/opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "/opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk 1073741824" returned: 0 in 0.073s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Successfully created port: 66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Cannot resize image /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'migration_context' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Ensure instance console log exists: /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Successfully updated port: 66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquired lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-changed-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Refreshing instance network info cache due to event network-changed-66d323ba-5273-4b45-b683-270ec1ef916b. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] Acquiring lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updating instance_info_cache with network_info: [{"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Releasing lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Instance network_info: |[{"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] Acquired lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Refreshing network info cache for port 66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Start _get_guest_xml network_info=[{"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:23:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1053167',id=9,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQEPGwUkRp7YY3linYig9SIZ1aDdByngSgaGbCG2cXtlGufg1L9C6FeagDwEl0tWhIjwl2JGi5zY+m1mBPKXXEA8NpPjor1znZyeVgxTQeUxebzRBRdl4mnyecQ9pAVZQ==',key_name='tempest-keypair-1628416866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79baf779b6b8403d98a284fccb6d7ebf',ramdisk_id='',reservation_id='r-xhlpn0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca72a24784cd40f09c6123c19ab19943',uuid=e797292e-bcd5-427c-bbfc-c35031f648e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converting VIF {"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'pci_devices' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:23:37 user nova-compute[72863]:   <uuid>e797292e-bcd5-427c-bbfc-c35031f648e5</uuid>
Aug 15 13:23:37 user nova-compute[72863]:   <name>instance-00000009</name>
Aug 15 13:23:37 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:23:37 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:23:37 user nova-compute[72863]:   <metadata>
Aug 15 13:23:37 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:23:37 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185</nova:name>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:23:37</nova:creationTime>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:23:37 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:23:37 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:owner>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:user uuid="ca72a24784cd40f09c6123c19ab19943">tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member</nova:user>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:project uuid="79baf779b6b8403d98a284fccb6d7ebf">tempest-TestServerVolumeAttachScenarioOldVersion-1517725918</nova:project>
Aug 15 13:23:37 user nova-compute[72863]:       </nova:owner>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:23:37 user nova-compute[72863]:       <nova:ports>
Aug 15 13:23:37 user nova-compute[72863]:         <nova:port uuid="66d323ba-5273-4b45-b683-270ec1ef916b">
Aug 15 13:23:37 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:23:37 user nova-compute[72863]:         </nova:port>
Aug 15 13:23:37 user nova-compute[72863]:       </nova:ports>
Aug 15 13:23:37 user nova-compute[72863]:     </nova:instance>
Aug 15 13:23:37 user nova-compute[72863]:   </metadata>
Aug 15 13:23:37 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:23:37 user nova-compute[72863]:     <system>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="serial">e797292e-bcd5-427c-bbfc-c35031f648e5</entry>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="uuid">e797292e-bcd5-427c-bbfc-c35031f648e5</entry>
Aug 15 13:23:37 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:23:37 user nova-compute[72863]:     </system>
Aug 15 13:23:37 user nova-compute[72863]:   </sysinfo>
Aug 15 13:23:37 user nova-compute[72863]:   <os>
Aug 15 13:23:37 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:23:37 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:23:37 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:23:37 user nova-compute[72863]:   </os>
Aug 15 13:23:37 user nova-compute[72863]:   <features>
Aug 15 13:23:37 user nova-compute[72863]:     <acpi/>
Aug 15 13:23:37 user nova-compute[72863]:     <apic/>
Aug 15 13:23:37 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:23:37 user nova-compute[72863]:   </features>
Aug 15 13:23:37 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:23:37 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:23:37 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:23:37 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:23:37 user nova-compute[72863]:   </clock>
Aug 15 13:23:37 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:23:37 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:23:37 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:23:37 user nova-compute[72863]:   </cpu>
Aug 15 13:23:37 user nova-compute[72863]:   <devices>
Aug 15 13:23:37 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:23:37 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:23:37 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk"/>
Aug 15 13:23:37 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:23:37 user nova-compute[72863]:     </disk>
Aug 15 13:23:37 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:23:37 user nova-compute[72863]:       <mac address="fa:16:3e:ab:7b:c5"/>
Aug 15 13:23:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:37 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:23:37 user nova-compute[72863]:       <target dev="tap66d323ba-52"/>
Aug 15 13:23:37 user nova-compute[72863]:     </interface>
Aug 15 13:23:37 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:23:37 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/console.log" append="off"/>
Aug 15 13:23:37 user nova-compute[72863]:     </serial>
Aug 15 13:23:37 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:23:37 user nova-compute[72863]:     <video>
Aug 15 13:23:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:23:37 user nova-compute[72863]:     </video>
Aug 15 13:23:37 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:23:37 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:23:37 user nova-compute[72863]:     </rng>
Aug 15 13:23:37 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:23:37 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:23:37 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:23:37 user nova-compute[72863]:     </memballoon>
Aug 15 13:23:37 user nova-compute[72863]:   </devices>
Aug 15 13:23:37 user nova-compute[72863]: </domain>
Aug 15 13:23:37 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1053167',id=9,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQEPGwUkRp7YY3linYig9SIZ1aDdByngSgaGbCG2cXtlGufg1L9C6FeagDwEl0tWhIjwl2JGi5zY+m1mBPKXXEA8NpPjor1znZyeVgxTQeUxebzRBRdl4mnyecQ9pAVZQ==',key_name='tempest-keypair-1628416866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79baf779b6b8403d98a284fccb6d7ebf',ramdisk_id='',reservation_id='r-xhlpn0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca72a24784cd40f09c6123c19ab19943',uuid=e797292e-bcd5-427c-bbfc-c35031f648e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converting VIF {"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG os_vif [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66d323ba-52, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66d323ba-52, col_values=(('external_ids', {'iface-id': '66d323ba-5273-4b45-b683-270ec1ef916b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:7b:c5', 'vm-uuid': 'e797292e-bcd5-427c-bbfc-c35031f648e5'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:23:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:37 user nova-compute[72863]: INFO os_vif [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52')
Aug 15 13:23:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:23:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] No VIF found with MAC fa:16:3e:ab:7b:c5, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:23:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updated VIF entry in instance network info cache for port 66d323ba-5273-4b45-b683-270ec1ef916b. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:23:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updating instance_info_cache with network_info: [{"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:23:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f43257a-815f-4cbf-9569-b7aba72f3187 req-b8cb9986-0870-4bc7-b194-57be5d680cbf service nova] Releasing lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] No waiting events found dispatching network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:39 user nova-compute[72863]: WARNING nova.compute.manager [req-0d5317b7-347d-4642-bd43-a8c3f7fd4a36 req-596c7460-a27f-428b-8d3a-b21a27959ef1 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received unexpected event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b for instance with vm_state building and task_state spawning.
Aug 15 13:23:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] No waiting events found dispatching network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:23:41 user nova-compute[72863]: WARNING nova.compute.manager [req-31b6928c-6f5b-430b-aa9a-875b48170547 req-70f89b69-f466-42d8-9e40-2e5e5103e8c3 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received unexpected event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b for instance with vm_state building and task_state spawning.
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105821.7910063, e797292e-bcd5-427c-bbfc-c35031f648e5 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] VM Resumed (Lifecycle Event)
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Instance spawned successfully.
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105821.7923222, e797292e-bcd5-427c-bbfc-c35031f648e5 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] VM Started (Lifecycle Event)
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:23:41 user nova-compute[72863]: INFO nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 15 13:23:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:23:42 user nova-compute[72863]: INFO nova.compute.manager [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Took 7.58 seconds to build instance.
Aug 15 13:23:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cf0c4946-ab80-45c7-a45c-21ee26566557 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.716s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:23:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:23:54 user nova-compute[72863]: INFO nova.compute.claims [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Claim successful on node user
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:23:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:23:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:23:55 user nova-compute[72863]: INFO nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Booting with volume d7049283-3fba-4e22-8c15-3780aed84d7e at /dev/vda
Aug 15 13:23:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:23:55 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpq6ggnv1p/privsep.sock']
Aug 15 13:23:55 user sudo[84061]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpq6ggnv1p/privsep.sock
Aug 15 13:23:55 user sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 13:23:55 user nova-compute[72863]: DEBUG nova.policy [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faaa2918e9a347e687b777c36594e537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb861158c2c430db44cb7153bb0a7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:23:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully created port: 738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully created port: fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:57 user sudo[84061]: pam_unix(sudo:session): session closed for user root
Aug 15 13:23:57 user nova-compute[72863]: INFO oslo.privsep.daemon [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Spawned new privsep daemon via rootwrap
Aug 15 13:23:57 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 13:23:57 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 13:23:57 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 13:23:57 user nova-compute[72863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84064
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8c9374-93c9-40c1-a918-472b127ec4c6]: (2,) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c402e0-8272-4676-af3f-c7a0e2796273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.nvmeof [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully created port: f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6d271-f342-4ad0-95b8-aa4820653042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153d4d6-d70f-487b-b4e2-784790aab41d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefa4b1-a249-4dd0-85d4-7fc84848154d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:23:57 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:23:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9093a7-3dc4-421e-a0a5-04b4f503e589]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== get_connector_properties: return (2029ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating existing volume attachment record: 6ab9a16f-8800-427b-8ce9-aebd52365150 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:23:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully created port: 9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully created port: b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: 738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-738e2c06-cfbf-4143-aad3-92ae2373b304. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG nova.network.neutron [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port 738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:23:59 user nova-compute[72863]: DEBUG nova.network.neutron [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-49591170-499f-45ec-978b-8c5882585d45 req-434a7246-751a-46cd-9c7b-237b8a2c1a5d service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: 7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-7f39f606-4844-46af-aa86-90962eed1e3b. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port 7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-cbb01944-1f0c-43ff-a5d1-3d2b88619793. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d439017c-a4e4-4b96-9373-05e5576fd997 req-346f1b19-d384-4410-8ea4-64cadb565bf9 service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:24:02 user nova-compute[72863]: INFO nova.compute.claims [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Claim successful on node user
Aug 15 13:24:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:24:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:24:03 user nova-compute[72863]: INFO nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Booting with volume ace87f0d-67b7-4f80-a13c-260c4727a27d at /dev/vda
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: 9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36fc55c-5abb-4b42-95c5-40e07a73bb9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.policy [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b5668c5b8b242de9bb4f36bc48b39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affb9a0688ef4d27bed4b287354ef670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6147439c-f6ed-4876-b92b-36b7ed0fff3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d7ea0-0c44-45c2-b8ab-a52dc8ab711e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11b4c0-274c-405a-9ce5-325d2d2e5725]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:03 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49afe28-e5be-457d-8a74-1480adbbfd0e]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:03 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating existing volume attachment record: 1fe94e37-0d1e-4539-a181-430fb5100b45 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-f163558b-dffd-46d6-96e2-6c8c0942f38a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a9457659-cd28-4f50-912d-7901a611fa94 req-37ce47ca-3937-489d-abd5-5c7b4376441b service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully created port: 362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Successfully updated port: b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-b55552da-6f98-4a09-b731-777777c7bb74. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully created port: d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:24:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully created port: 1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:24:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-9d8e1bfa-c8a7-423c-b675-77985bd6a771. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully created port: e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:24:06 user nova-compute[72863]: INFO nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Booting with volume e3b3c5df-a7e4-4e94-93e2-d017da42c452 at /dev/vdb
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance network_info: |[{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f29730-a88b-4cd8-bd55-00211527fab3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6cfb1-781e-4723-96cf-36bf6ee8cd52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7904809e-a700-44a6-83a9-4dec3c8c7307]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38452f1d-095a-444a-8e4b-edaefc264c24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:06 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e9a4ac-0db1-4060-886a-8a740fbc1e0a]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating existing volume attachment record: 7713b7a0-3ebc-4a80-bd19-f4be8631c669 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully created port: b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updated VIF entry in instance network info cache for port b55552da-6f98-4a09-b731-777777c7bb74. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-382d0ef8-02ea-4322-83c0-bccddb227ff1 req-63a25e9b-398c-4137-9d1a-4457dc00b919 service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port 9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: 362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-362939d4-30f2-4f0e-8dda-073fdb3b5979. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port 362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updated VIF entry in instance network info cache for port 9d8e1bfa-c8a7-423c-b675-77985bd6a771. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b2c38003-95b0-4455-9a2f-afd00bf254ea req-d46f0264-f190-4321-ae29-456e58ee5fe5 service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38499949-fb6e-4d33-945c-1d12bca72142 req-224a668b-9b0e-4771-ba83-54151dc9c701 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: 9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: 9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-9810641c-fb74-472f-828f-d1f81adb8b49. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port 9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-9b7efb24-ccec-4906-aaf1-cc946e10b31a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port 9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f580798-01e4-4a04-aaca-0fbfa3bc47ce req-b1e8a55e-51aa-4261-9c09-41850755b7f6 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: 1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-d16b09b9-0a48-4760-8be3-948cf22cc66a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-1f427130-8d12-496d-b601-58d07da6fbad. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port 1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0d8770f-95a6-4473-a851-1419b5fa7d39 req-de0ee4da-d844-48fb-9a26-bece3298801a service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Successfully updated port: b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:24:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:13 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-e91d807f-c2e4-426a-aee6-d06779ef3c41. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance network_info: |[{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updated VIF entry in instance network info cache for port e91d807f-c2e4-426a-aee6-d06779ef3c41. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-b12034d7-ddcc-49d7-afa1-948ef30ee323. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updated VIF entry in instance network info cache for port b12034d7-ddcc-49d7-afa1-948ef30ee323. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8a4f5377-54a3-4e33-b1ee-918efadec76c req-a5aed626-74a0-4dea-a415-dec42d236a22 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:18 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:18 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6991MB free_disk=25.863662719726562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9da5205c-ed07-4087-87b3-1c49f309154a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f48d3dd5-fb94-4688-bbbb-375136f04c76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b33fd6c7-9e23-436a-858c-2767f8baf885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e797292e-bcd5-427c-bbfc-c35031f648e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:24:18 user nova-compute[72863]: INFO nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Booting with volume c9969ad2-ecb7-4918-bc44-725851c4d3ff at /dev/vdb
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d09ca-8548-4561-8edd-266db65d5241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d008964-7807-42e9-acf2-d66c2fe7e21a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[986738da-4e9f-4da3-b51d-b11b91c21e32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdaaa04-4ccf-4a43-8710-c4f98be9729f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:18 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2be92b-8cbe-401a-9809-27cc16740e95]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating existing volume attachment record: 84ddb608-393d-45d7-8456-473eb9916858 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:24:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:24:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:24:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:24 user nova-compute[72863]: INFO nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Booting with volume 6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 at /dev/vdc
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e64ee-71da-4c62-bc74-622059d53a68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae72c3f-66a8-47a8-b9e1-3b3a523ff401]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[497583ff-2f4a-4a08-bf16-4e5946f2012e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a66f5e-3945-4c4d-937f-53e0caa0ce7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:24 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[395dcebc-91b3-476e-8763-98d8279a9cdd]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG os_brick.utils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:24 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating existing volume attachment record: 0c407737-7921-40cd-ac37-9375c37f9cdd {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG nova.objects.instance [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lazy-loading 'flavor' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Attaching volume 9e56e196-bb42-470a-8ad3-88e75e91ba79 to /dev/vdb
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb4e88b-2d61-43d8-b1f7-d8f0875f5848]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a6f6d-c860-4006-ac72-4e7e230817ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b3f545-1a6e-42b6-a4b5-7d99a34889d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2270195d-59f2-4765-ada1-7db96c32581b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:26 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5119878-1649-4298-8dc8-104a31409c8b]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:26 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updating existing volume attachment record: aa899a59-d4d9-474a-95e6-c6a18c8ec585 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:27 user nova-compute[72863]: INFO nova.compute.manager [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] instance snapshotting
Aug 15 13:24:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Beginning live snapshot process
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46.delta 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46.delta 1073741824" returned: 0 in 0.047s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 13:24:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72863) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 13:24:28 user nova-compute[72863]: INFO nova.virt.libvirt.host [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] UEFI support detected
Aug 15 13:24:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:24:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 13:24:29 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46.delta /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-changed-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Refreshing instance network info cache due to event network-changed-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] Acquiring lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] Acquired lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Refreshing network info cache for port 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46.delta /opt/stack/data/nova/instances/snapshots/tmpvg1t4p_a/104269038e7b48769c828862ffb89f46" returned: 0 in 0.405s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Snapshot extracted, beginning image upload
Aug 15 13:24:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updated VIF entry in instance network info cache for port 4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating instance_info_cache with network_info: [{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e164e494-4037-4bcd-96e5-65c6194b6309 req-d3cfc838-dba4-49a5-a544-df8068117106 service nova] Releasing lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:31 user nova-compute[72863]: DEBUG nova.compute.manager [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-changed-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:31 user nova-compute[72863]: DEBUG nova.compute.manager [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Refreshing instance network info cache due to event network-changed-2b260b4c-bea8-4b7d-9131-0a938ed031e6. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:31 user nova-compute[72863]: DEBUG nova.network.neutron [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Refreshing network info cache for port 2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:32 user nova-compute[72863]: DEBUG nova.network.neutron [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updated VIF entry in instance network info cache for port 2b260b4c-bea8-4b7d-9131-0a938ed031e6. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:32 user nova-compute[72863]: DEBUG nova.network.neutron [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e844d8a3-3373-4fec-a56a-845fb08776eb req-bf7efcb0-10e5-4121-a583-b47d86230be6 service nova] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Snapshot image upload complete
Aug 15 13:24:32 user nova-compute[72863]: INFO nova.compute.manager [None req-6fbbc411-12a3-4bc8-9a81-797d200a9a0b tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Took 5.20 seconds to snapshot the instance on the hypervisor.
Aug 15 13:24:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connector [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Factory for ISCSI on None {{(pid=72863) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnuBgkKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:36 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c371e17-68e2-4690-a63a-16281ca530da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:36 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d8aa88-f377-47d1-89b5-f1a60ff96a60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79] added
Aug 15 13:24:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a1dc89-e393-43fb-a491-de866729e73f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7c563-5bc0-4a20-af9d-17ef84a11b6e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnuBgkKA {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: INFO nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Booting with volume 464447d6-45b5-4a5f-b0e8-d9530f015bd5 at /dev/vdc
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnuBgkKA" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab24ced9-43b7-4991-a4ae-e82e4efd8e7e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnuBgkKA'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ad2437-e432-4fdb-95c9-c046cbd46d28]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a69897-4c25-4633-af15-da9dc46e61d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:24:36 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:24:36 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:24:36 user nova-compute[72863]: 
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba8cb6-c580-4afd-910c-5a9a8c386193]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260]
Aug 15 13:24:36 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d582cee-6764-4599-9452-2cdcf15d28f5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c09a48e-8a05-4d4e-bd81-15b4c46ff97e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)
Aug 15 13:24:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)
Aug 15 13:24:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c2782-d802-4e11-b2b9-e4de1049d130]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnuBgkKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b499a03-8c29-45a9-89ea-d998cc857281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41df2e0-6567-45a1-b69d-372fe0978c4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63488372-f131-485f-9689-11447fa9c32f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e17297-918f-41e6-81cd-14958f2f2bba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:36 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31857a-1347-4221-9aa3-2db0e04f5dea]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG os_brick.utils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:36 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating existing volume attachment record: 55547020-6ffc-4169-beae-4837cc46685a {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23031376132396165', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031376132396165', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lazy-loading 'flavor' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:24:37 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:37 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:24:37 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:24:37 user nova-compute[72863]:   <serial>9e56e196-bb42-470a-8ad3-88e75e91ba79</serial>
Aug 15 13:24:37 user nova-compute[72863]: </disk>
Aug 15 13:24:37 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:24:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] No VIF found with MAC fa:16:3e:af:87:33, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-bde8ea81-aaba-46b9-b33b-10585e66a144 tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.756s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:39 user nova-compute[72863]: INFO nova.compute.manager [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Terminating instance
Aug 15 13:24:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-unplugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] No waiting events found dispatching network-vif-unplugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85b8cde4-b012-4a12-b793-3e89ce02769b req-f5ee1761-8c68-4152-8f9a-768bd822f6cf service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-unplugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:40 user nova-compute[72863]: INFO nova.compute.manager [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Attaching volume 04eda795-d566-42e7-bbc8-393bd0b46b93 to /dev/vdb
Aug 15 13:24:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Instance destroyed successfully.
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lazy-loading 'resources' on Instance uuid 9da5205c-ed07-4087-87b3-1c49f309154a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1061813752',display_name='tempest-DeleteServersTestJSON-server-1061813752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1061813752',id=1,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aa26bb5186046a7bbdbfecbe9e7b2e1',ramdisk_id='',reservation_id='r-s1ehktzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1460024248',owner_user_name='tempest-DeleteServersTestJSON-1460024248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:22:53Z,user_data=None,user_id='44ee4fd69fb1480d8b93941b8867ae52',uuid=9da5205c-ed07-4087-87b3-1c49f309154a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converting VIF {"id": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "address": "fa:16:3e:af:87:33", "network": {"id": "93295ca7-b332-48d8-b2b7-448fe7ff0809", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1043550864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aa26bb5186046a7bbdbfecbe9e7b2e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082c7b7-5f", "ovs_interfaceid": "6082c7b7-5fa7-45e5-8d35-6761319d72d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_vif [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6082c7b7-5f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:40 user nova-compute[72863]: INFO os_vif [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:87:33,bridge_name='br-int',has_traffic_filtering=True,id=6082c7b7-5fa7-45e5-8d35-6761319d72d0,network=Network(93295ca7-b332-48d8-b2b7-448fe7ff0809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082c7b7-5f')
Aug 15 13:24:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnuBgkKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:40 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ae236-ebaf-4c38-aa1a-0b26ba2da4d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b82db97-1d90-46b1-9996-a7d6557c3a7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)
Aug 15 13:24:40 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 (non-flash)
Aug 15 13:24:40 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff52408fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9d810-db6c-45e4-840a-c17e2abe2bd1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34c3274-1145-4eaa-aa71-89ead089dcf3]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f12f74-62f2-4a32-ad67-0b0c3c90931c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21935fce-ba6b-43c5-a9d5-1d95e769bf3e]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3b332-155b-41c8-aaa1-06e6f1ff25c1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898dc70-36fa-4712-8e23-860588a8ad5a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260]
Aug 15 13:24:41 user nova-compute[72863]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:41 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e56e196-bb42-470a-8ad3-88e75e91ba79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0c34c2-8db1-4cea-bbbb-053903d94880]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] <== disconnect_volume: return (279ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:24:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Deleting instance files /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a_del
Aug 15 13:24:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Deletion of /opt/stack/data/nova/instances/9da5205c-ed07-4087-87b3-1c49f309154a_del complete
Aug 15 13:24:41 user nova-compute[72863]: INFO nova.compute.manager [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.utils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189609b-cc70-4716-9870-b2d0e6b9f1b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebf7058-231a-44bc-853e-47353f0f839c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[720fade4-9331-45d5-9065-98059be2c014]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af20ea-148a-44e6-9fe4-b422c5022644]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:41 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5f4f4-02ee-4638-b139-dbf59909d482]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG os_brick.utils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating existing volume attachment record: 6fbee68d-6844-4320-802b-8537ac9d6e4d {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:41 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Took 0.78 seconds to deallocate network for instance.
Aug 15 13:24:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-e09828b1-8d6e-47de-a64e-5c2fa7fca31e req-61a4eb3b-3bd7-4c81-a53d-0185c6a6623a service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-deleted-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] Acquiring lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] Lock "9da5205c-ed07-4087-87b3-1c49f309154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] No waiting events found dispatching network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:42 user nova-compute[72863]: WARNING nova.compute.manager [req-5e8b93f8-4c75-4a4d-a79d-12155e8385be req-26a315a5-da2f-4fe7-a81d-4987b6431e0e service nova] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Received unexpected event network-vif-plugged-6082c7b7-5fa7-45e5-8d35-6761319d72d0 for instance with vm_state active and task_state deleting.
Aug 15 13:24:44 user nova-compute[72863]: INFO nova.compute.manager [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Took 2.26 seconds to detach 1 volumes for instance.
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:44 user nova-compute[72863]: INFO nova.compute.manager [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Attaching volume fc33af2d-4882-4984-afe0-65728dc7d395 to /dev/vdb
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:24:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Creating image(s)
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Ensure instance console log exists: /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Start _get_guest_xml network_info=[{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ab9a16f-8800-427b-8ce9-aebd52365150', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsAvkgwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7049283-3fba-4e22-8c15-3780aed84d7e', 'serial': 'd7049283-3fba-4e22-8c15-3780aed84d7e'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '7713b7a0-3ebc-4a80-bd19-f4be8631c669', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzKpSqMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3b3c5df-a7e4-4e94-93e2-d017da42c452', 'serial': 'e3b3c5df-a7e4-4e94-93e2-d017da42c452'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '0c407737-7921-40cd-ac37-9375c37f9cdd', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCKvInRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099', 'attached_at': '', 'detached_at': '', 'volume_id': '6e2d22c4-5ff0-4ba1-aa89-783dcac145b2', 'serial': '6e2d22c4-5ff0-4ba1-aa89-783dcac145b2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:24:44 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:44 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsAvkgwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:44 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:44 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:44 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c0ddc-e578-485f-87b5-162dfb10a762]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:44 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b7efae-c293-43bd-968c-eefe0d2b78e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e] added
Aug 15 13:24:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23316511-ce62-4588-8b56-6b68865cd57f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9141af9-6466-409f-a003-e8f8d52c0145]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsAvkgwQ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsAvkgwQ" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecafc72-a9cc-4cc5-8aec-15343962de9c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsAvkgwQ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55325bcb-c197-4cc2-bf43-e2221a12ad9e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35197cbf-f366-421f-89c9-694846f1a193]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:24:44 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:24:44 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:44 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:24:44 user nova-compute[72863]: 
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf8e354-064f-412c-9f5b-cc45d12274c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260]
Aug 15 13:24:44 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Deleted allocations for instance 9da5205c-ed07-4087-87b3-1c49f309154a
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb3455-da75-4549-8e90-e04bc96b6e9d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.utils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca87cfa-9635-4a0e-b9b2-9521e7703e93]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056a2d8-9278-4a29-b211-328b98ba708b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc0a62a-471b-418f-80a7-3ce688f654ba]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsAvkgwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7dccba-b0e4-4b84-a0c2-be5bdb865018]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d589c60d-62c1-441c-8901-f6fa10714c44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf0b39-069b-433f-8cfe-f1a4bc6c0a93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9c03ac60-1666-4126-970d-18c48e09e17b tempest-DeleteServersTestJSON-1460024248 tempest-DeleteServersTestJSON-1460024248-project-member] Lock "9da5205c-ed07-4087-87b3-1c49f309154a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.038s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:45 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917cc33-7623-40d9-99cd-70015bcc3f66]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.utils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating existing volume attachment record: bc0d26e2-6f49-4671-a067-018e38411aa1 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26265643438643831', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265643438643831', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzKpSqMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:45 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:45 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:45 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a4658-8cfa-490a-a263-1369d9b88612]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:45 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33186b7-8830-4d45-8502-0117dcdd87fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452] added
Aug 15 13:24:45 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94159389-2d86-419a-af52-3ab29f3b16d4]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[003bfef5-4cdc-4c5a-a379-175d6168ec8a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzKpSqMR {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzKpSqMR" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b564c9-d49b-4a50-b9f2-0c4e76cc6061]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzKpSqMR'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abe69e5-a047-4161-b533-4c75cab2ca41]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[047502b0-c942-4668-8496-94e921163bfd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804699d-f05d-40b9-85a7-f21a3ddf36af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260]
Aug 15 13:24:46 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8623c9-62c2-4e3a-8c9e-ce4cb7ed039f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50471d-ccf5-4344-b016-f12e81653e01]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:46 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:46 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[490387a0-4e66-40ba-8cc0-891307a271e1]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzKpSqMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23431376233633063', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431376233633063', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:24:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Creating image(s)
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Ensure instance console log exists: /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Start _get_guest_xml network_info=[{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1fe94e37-0d1e-4539-a181-430fb5100b45', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNuxdKZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3de4784-eb7e-4601-a3d4-2f0107849f61', 'attached_at': '', 'detached_at': '', 'volume_id': 'ace87f0d-67b7-4f80-a13c-260c4727a27d', 'serial': 'ace87f0d-67b7-4f80-a13c-260c4727a27d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '84ddb608-393d-45d7-8456-473eb9916858', 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnVCrKqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3de4784-eb7e-4601-a3d4-2f0107849f61', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9969ad2-ecb7-4918-bc44-725851c4d3ff', 'serial': 'c9969ad2-ecb7-4918-bc44-725851c4d3ff'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '55547020-6ffc-4169-beae-4837cc46685a', 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIWxXBSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3de4784-eb7e-4601-a3d4-2f0107849f61', 'attached_at': '', 'detached_at': '', 'volume_id': '464447d6-45b5-4a5f-b0e8-d9530f015bd5', 'serial': '464447d6-45b5-4a5f-b0e8-d9530f015bd5'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCKvInRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:47 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:47 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:47 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNuxdKZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:47 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8e9e1-2c9a-42e7-b2e2-f4fafea2f945]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:47 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff22010-04f4-43a2-a3e7-fb15a35b54eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2] added
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7284bc9-ab01-41b6-9f21-c3ef232d9390]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd37cf0-b4a0-4350-908a-1beb021d7261]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCKvInRD {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCKvInRD" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45bd1f2-025a-4b16-a936-41b23582ac38]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCKvInRD'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79531e88-ea41-4b84-aeef-31cafeb5b69f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be01d3c4-0b9d-42a4-83ea-2882e663e8d0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff37c79f-d0a1-4732-ba7a-a804811a7bfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260]
Aug 15 13:24:47 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028f7ea-a774-41b8-ae9d-c3cf11eed9e7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab79ec6-4b7a-4c79-83e9-1fc5a8e3f906]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d64e63-6c14-48d5-be54-67ce587e9e0b]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCKvInRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26463663534613536', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463663534613536', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.334s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:48 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:48 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5a2ce-507c-43b9-9d9e-c2d0415ef38d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:48 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lazy-loading 'pci_devices' on Instance uuid 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d122c-1e97-4b30-92ba-9bb99b41ec34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d] added
Aug 15 13:24:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:24:48 user nova-compute[72863]:   <uuid>699ef2fc-40ef-45fc-b89a-5f8ef55e7099</uuid>
Aug 15 13:24:48 user nova-compute[72863]:   <name>instance-0000000a</name>
Aug 15 13:24:48 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:24:48 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:24:48 user nova-compute[72863]:   <metadata>
Aug 15 13:24:48 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:24:48 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:name>tempest-device-tagging-server-1762836650</nova:name>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:24:44</nova:creationTime>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:24:48 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:24:48 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:owner>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:user uuid="faaa2918e9a347e687b777c36594e537">tempest-TaggedBootDevicesTest-2024362299-project-member</nova:user>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:project uuid="dfb861158c2c430db44cb7153bb0a7ef">tempest-TaggedBootDevicesTest-2024362299</nova:project>
Aug 15 13:24:48 user nova-compute[72863]:       </nova:owner>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:24:48 user nova-compute[72863]:       <nova:ports>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="738e2c06-cfbf-4143-aad3-92ae2373b304">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="7f39f606-4844-46af-aa86-90962eed1e3b">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="cbb01944-1f0c-43ff-a5d1-3d2b88619793">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="fff0517f-9ffa-4467-ae63-ebd11a0b8ec3">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="f163558b-dffd-46d6-96e2-6c8c0942f38a">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="9d8e1bfa-c8a7-423c-b675-77985bd6a771">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:         <nova:port uuid="b55552da-6f98-4a09-b731-777777c7bb74">
Aug 15 13:24:48 user nova-compute[72863]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 13:24:48 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:48 user nova-compute[72863]:       </nova:ports>
Aug 15 13:24:48 user nova-compute[72863]:     </nova:instance>
Aug 15 13:24:48 user nova-compute[72863]:   </metadata>
Aug 15 13:24:48 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:24:48 user nova-compute[72863]:     <system>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="serial">699ef2fc-40ef-45fc-b89a-5f8ef55e7099</entry>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="uuid">699ef2fc-40ef-45fc-b89a-5f8ef55e7099</entry>
Aug 15 13:24:48 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:24:48 user nova-compute[72863]:     </system>
Aug 15 13:24:48 user nova-compute[72863]:   </sysinfo>
Aug 15 13:24:48 user nova-compute[72863]:   <os>
Aug 15 13:24:48 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:24:48 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:24:48 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:24:48 user nova-compute[72863]:   </os>
Aug 15 13:24:48 user nova-compute[72863]:   <features>
Aug 15 13:24:48 user nova-compute[72863]:     <acpi/>
Aug 15 13:24:48 user nova-compute[72863]:     <apic/>
Aug 15 13:24:48 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:24:48 user nova-compute[72863]:   </features>
Aug 15 13:24:48 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:24:48 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:24:48 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:24:48 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:24:48 user nova-compute[72863]:   </clock>
Aug 15 13:24:48 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:24:48 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:24:48 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:24:48 user nova-compute[72863]:   </cpu>
Aug 15 13:24:48 user nova-compute[72863]:   <devices>
Aug 15 13:24:48 user nova-compute[72863]:     <disk type="file" device="cdrom">
Aug 15 13:24:48 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 13:24:48 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/disk.config"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="hda" bus="ide"/>
Aug 15 13:24:48 user nova-compute[72863]:     </disk>
Aug 15 13:24:48 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:48 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:48 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <serial>d7049283-3fba-4e22-8c15-3780aed84d7e</serial>
Aug 15 13:24:48 user nova-compute[72863]:     </disk>
Aug 15 13:24:48 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:48 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:48 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <serial>e3b3c5df-a7e4-4e94-93e2-d017da42c452</serial>
Aug 15 13:24:48 user nova-compute[72863]:     </disk>
Aug 15 13:24:48 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:48 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:48 user nova-compute[72863]:       <source dev="/dev/sdd"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="vdc" bus="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <serial>6e2d22c4-5ff0-4ba1-aa89-783dcac145b2</serial>
Aug 15 13:24:48 user nova-compute[72863]:     </disk>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:09:00:e4"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tap738e2c06-cf"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:90:be:b1"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tap7f39f606-48"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:93:f6:6e"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tapcbb01944-1f"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:21:f0:7b"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tapfff0517f-9f"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:b6:22:69"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tapf163558b-df"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:dd:41:28"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tap9d8e1bfa-c8"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:48 user nova-compute[72863]:       <mac address="fa:16:3e:af:dd:98"/>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:48 user nova-compute[72863]:       <target dev="tapb55552da-6f"/>
Aug 15 13:24:48 user nova-compute[72863]:     </interface>
Aug 15 13:24:48 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:24:48 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/console.log" append="off"/>
Aug 15 13:24:48 user nova-compute[72863]:     </serial>
Aug 15 13:24:48 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:24:48 user nova-compute[72863]:     <video>
Aug 15 13:24:48 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:48 user nova-compute[72863]:     </video>
Aug 15 13:24:48 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:24:48 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:24:48 user nova-compute[72863]:     </rng>
Aug 15 13:24:48 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:24:48 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:24:48 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:24:48 user nova-compute[72863]:     </memballoon>
Aug 15 13:24:48 user nova-compute[72863]:   </devices>
Aug 15 13:24:48 user nova-compute[72863]: </domain>
Aug 15 13:24:48 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d21d65-c1ea-407d-8ad1-0d9736eab175]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738e2c06-cf, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap738e2c06-cf, col_values=(('external_ids', {'iface-id': '738e2c06-cfbf-4143-aad3-92ae2373b304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:00:e4', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe5db4-4fb8-4dd6-8f4d-40cee08756fe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNuxdKZw {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf')
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f39f606-48, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f39f606-48, col_values=(('external_ids', {'iface-id': '7f39f606-4844-46af-aa86-90962eed1e3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:be:b1', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lNuxdKZw" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[874204f7-9402-428f-bf02-e49135318ad0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lNuxdKZw'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48')
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b7a4d-b041-49c7-b7de-4260f7706459]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbb01944-1f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbb01944-1f, col_values=(('external_ids', {'iface-id': 'cbb01944-1f0c-43ff-a5d1-3d2b88619793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f6:6e', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c31a8f-90dc-4da1-9624-8f67eaccad4f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:48 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:48 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:48 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:48 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f')
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfff0517f-9f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfff0517f-9f, col_values=(('external_ids', {'iface-id': 'fff0517f-9ffa-4467-ae63-ebd11a0b8ec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:f0:7b', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f')
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf163558b-df, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf163558b-df, col_values=(('external_ids', {'iface-id': 'f163558b-dffd-46d6-96e2-6c8c0942f38a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:22:69', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef5523-1b39-4308-bfce-38186b8849fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260]
Aug 15 13:24:49 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6bbc9-c951-4195-a745-a9de83333c47]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-changed-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Refreshing instance network info cache due to event network-changed-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] Acquiring lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] Acquired lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Refreshing network info cache for port f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df')
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af333d1-9b7a-4851-9208-dca65b6309bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d8e1bfa-c8, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d8e1bfa-c8, col_values=(('external_ids', {'iface-id': '9d8e1bfa-c8a7-423c-b675-77985bd6a771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:41:28', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62b434-443a-4492-8704-5a25a8759785]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNuxdKZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8')
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb55552da-6f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb55552da-6f, col_values=(('external_ids', {'iface-id': 'b55552da-6f98-4a09-b731-777777c7bb74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:dd:98', 'vm-uuid': '699ef2fc-40ef-45fc-b89a-5f8ef55e7099'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: INFO os_vif [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f')
Aug 15 13:24:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] No BDM found with device name hda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] No VIF found with MAC fa:16:3e:09:00:e4, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] No VIF found with MAC fa:16:3e:b6:22:69, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Using config drive
Aug 15 13:24:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Creating config drive at /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/disk.config
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0m8xz3a4 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0m8xz3a4" returned: 0 in 0.063s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updated VIF entry in instance network info cache for port f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updating instance_info_cache with network_info: [{"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7da18bdc-a2d1-4a29-91c5-46989a5591a0 req-440e7e57-00fb-4fea-a2da-aaf5d62edf8d service nova] Releasing lock "refresh_cache-f48d3dd5-fb94-4688-bbbb-375136f04c76" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== connect_volume: return (2773ms) {'type': 'block', 'scsi_wwn': '23638633036643536', 'path': '/dev/sde'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638633036643536', 'path': '/dev/sde'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnVCrKqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:50 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:50 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:50 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14827967-57d2-40e4-a0ac-1e3398b72ac1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:50 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f3eb1-7bf1-4599-b7cb-7693076e2929]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff] added
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94ba465-3ab1-4882-a0e6-da53f72861ab]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f2fbad-b47f-4be4-bcf3-92a7362c848b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnVCrKqR {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnVCrKqR" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff9c63-2202-426c-9446-6673bf224589]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PnVCrKqR'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b7b4f-a6d9-4cce-8a3c-16c6d50cec01]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bedf62-920b-4c60-9a3d-f146f4ebcbde]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[045fdd48-7a1b-4deb-b0ab-2bfb59480f38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260]
Aug 15 13:24:50 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae948dc-36bc-40ca-9681-1f1af62b3f10]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05e925-2c62-4707-8706-627c57e7bf10]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:50 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a578b6-96ad-41cb-bf7d-840622c3635d]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnVCrKqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23133303732393338', 'path': '/dev/sdf'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133303732393338', 'path': '/dev/sdf'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIWxXBSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:51 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:51 user nova-compute[72863]: WARNING nova.compute.manager [req-094c2d2e-3396-4d76-a35a-117baf79c8a1 req-be2f4d55-0135-4c93-8da3-989d8fb61a81 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 for instance with vm_state building and task_state spawning.
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df738da3-b4bf-4f81-b975-0d05658bcf26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:51 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[348e9488-d07e-4301-9ace-dbc4f25be0e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5] added
Aug 15 13:24:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262640d-b74e-4851-986c-86b049a1af13]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[891d6248-66b6-4627-8368-21396c26ec6b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIWxXBSs {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIWxXBSs" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6108daf-5157-413d-9b58-b25b18d82ee5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIWxXBSs'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b93bb-7694-48dc-845d-cb77d4b76510]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee4325-8253-4ea4-8b17-ef0e9f19be9f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79064e4-4f2a-4d35-ae4c-934de036ec10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260]
Aug 15 13:24:51 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2985f24-f8bb-42b8-bee6-3e64a6db966c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac64bb8a-7d2f-4233-b8a7-ae9e91eca3cc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:52 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1088a96f-e841-4afe-b008-e647079aeb8e]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIWxXBSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:52 user nova-compute[72863]: WARNING nova.compute.manager [req-e2511563-ab2f-4e66-844f-3130b4b1cc49 req-e253986b-9c7f-49f6-8ac7-a1d3268bd8fc service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b for instance with vm_state building and task_state spawning.
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:52 user nova-compute[72863]: WARNING nova.compute.manager [req-e69eb7ae-c6cc-4266-9b27-3a62143c0165 req-44c41089-96f8-41dd-93e3-79944f8c8b0c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 for instance with vm_state building and task_state spawning.
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26463613330613132', 'path': '/dev/sdg'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463613330613132', 'path': '/dev/sdg'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.112s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:53 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lazy-loading 'pci_devices' on Instance uuid f3de4784-eb7e-4601-a3d4-2f0107849f61 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe6bda-1d96-4ace-b080-b62a84d2a3c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:53 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:24:53 user nova-compute[72863]:   <uuid>f3de4784-eb7e-4601-a3d4-2f0107849f61</uuid>
Aug 15 13:24:53 user nova-compute[72863]:   <name>instance-0000000b</name>
Aug 15 13:24:53 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:24:53 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:24:53 user nova-compute[72863]:   <metadata>
Aug 15 13:24:53 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:24:53 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:name>tempest-device-tagging-server-1692401444</nova:name>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:24:47</nova:creationTime>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:24:53 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:24:53 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:owner>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:user uuid="7b5668c5b8b242de9bb4f36bc48b39ad">tempest-TaggedBootDevicesTest_v242-777441795-project-member</nova:user>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:project uuid="affb9a0688ef4d27bed4b287354ef670">tempest-TaggedBootDevicesTest_v242-777441795</nova:project>
Aug 15 13:24:53 user nova-compute[72863]:       </nova:owner>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:24:53 user nova-compute[72863]:       <nova:ports>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="362939d4-30f2-4f0e-8dda-073fdb3b5979">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="9810641c-fb74-472f-828f-d1f81adb8b49">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="9b7efb24-ccec-4906-aaf1-cc946e10b31a">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="d16b09b9-0a48-4760-8be3-948cf22cc66a">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="1f427130-8d12-496d-b601-58d07da6fbad">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="e91d807f-c2e4-426a-aee6-d06779ef3c41">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:         <nova:port uuid="b12034d7-ddcc-49d7-afa1-948ef30ee323">
Aug 15 13:24:53 user nova-compute[72863]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 13:24:53 user nova-compute[72863]:         </nova:port>
Aug 15 13:24:53 user nova-compute[72863]:       </nova:ports>
Aug 15 13:24:53 user nova-compute[72863]:     </nova:instance>
Aug 15 13:24:53 user nova-compute[72863]:   </metadata>
Aug 15 13:24:53 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:24:53 user nova-compute[72863]:     <system>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="serial">f3de4784-eb7e-4601-a3d4-2f0107849f61</entry>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="uuid">f3de4784-eb7e-4601-a3d4-2f0107849f61</entry>
Aug 15 13:24:53 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:24:53 user nova-compute[72863]:     </system>
Aug 15 13:24:53 user nova-compute[72863]:   </sysinfo>
Aug 15 13:24:53 user nova-compute[72863]:   <os>
Aug 15 13:24:53 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:24:53 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:24:53 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:24:53 user nova-compute[72863]:   </os>
Aug 15 13:24:53 user nova-compute[72863]:   <features>
Aug 15 13:24:53 user nova-compute[72863]:     <acpi/>
Aug 15 13:24:53 user nova-compute[72863]:     <apic/>
Aug 15 13:24:53 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:24:53 user nova-compute[72863]:   </features>
Aug 15 13:24:53 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:24:53 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:24:53 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:24:53 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:24:53 user nova-compute[72863]:   </clock>
Aug 15 13:24:53 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:24:53 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:24:53 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:24:53 user nova-compute[72863]:   </cpu>
Aug 15 13:24:53 user nova-compute[72863]:   <devices>
Aug 15 13:24:53 user nova-compute[72863]:     <disk type="file" device="cdrom">
Aug 15 13:24:53 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 13:24:53 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/disk.config"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="hda" bus="ide"/>
Aug 15 13:24:53 user nova-compute[72863]:     </disk>
Aug 15 13:24:53 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:53 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:53 user nova-compute[72863]:       <source dev="/dev/sde"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <serial>ace87f0d-67b7-4f80-a13c-260c4727a27d</serial>
Aug 15 13:24:53 user nova-compute[72863]:     </disk>
Aug 15 13:24:53 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:53 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:53 user nova-compute[72863]:       <source dev="/dev/sdf"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <serial>c9969ad2-ecb7-4918-bc44-725851c4d3ff</serial>
Aug 15 13:24:53 user nova-compute[72863]:     </disk>
Aug 15 13:24:53 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:24:53 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:53 user nova-compute[72863]:       <source dev="/dev/sdg"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="vdc" bus="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <serial>464447d6-45b5-4a5f-b0e8-d9530f015bd5</serial>
Aug 15 13:24:53 user nova-compute[72863]:     </disk>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:11:9a:04"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tap362939d4-30"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:04:57:60"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tap9810641c-fb"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:60:b4:ad"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tap9b7efb24-cc"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:8c:b2:4e"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tapd16b09b9-0a"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:bb:0e:ce"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tap1f427130-8d"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:91:d9:86"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tape91d807f-c2"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:24:53 user nova-compute[72863]:       <mac address="fa:16:3e:4e:7d:91"/>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:24:53 user nova-compute[72863]:       <target dev="tapb12034d7-dd"/>
Aug 15 13:24:53 user nova-compute[72863]:     </interface>
Aug 15 13:24:53 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:24:53 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/console.log" append="off"/>
Aug 15 13:24:53 user nova-compute[72863]:     </serial>
Aug 15 13:24:53 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:24:53 user nova-compute[72863]:     <video>
Aug 15 13:24:53 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:24:53 user nova-compute[72863]:     </video>
Aug 15 13:24:53 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:24:53 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:24:53 user nova-compute[72863]:     </rng>
Aug 15 13:24:53 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:24:53 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:24:53 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:24:53 user nova-compute[72863]:     </memballoon>
Aug 15 13:24:53 user nova-compute[72863]:   </devices>
Aug 15 13:24:53 user nova-compute[72863]: </domain>
Aug 15 13:24:53 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd46670-c425-4e2e-ae0f-cf42446d07cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93] added
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap362939d4-30, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap362939d4-30, col_values=(('external_ids', {'iface-id': '362939d4-30f2-4f0e-8dda-073fdb3b5979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9a:04', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ec9bd-1d89-4bd2-873d-1ed0d9784cf5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9810641c-fb, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9810641c-fb, col_values=(('external_ids', {'iface-id': '9810641c-fb74-472f-828f-d1f81adb8b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:57:60', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5764b-682d-479d-94ee-cf5bd90ef217]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XohbjkDt {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XohbjkDt" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f6454f-d23b-489b-8302-2bcd0590ac36]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XohbjkDt'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca6fddb-0ead-4b1e-ad6f-7d050f4ea5bf]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b7efb24-cc, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b7efb24-cc, col_values=(('external_ids', {'iface-id': '9b7efb24-ccec-4906-aaf1-cc946e10b31a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:b4:ad', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4446544-71ed-4d39-8e55-b833042f0ad8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd16b09b9-0a, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd16b09b9-0a, col_values=(('external_ids', {'iface-id': 'd16b09b9-0a48-4760-8be3-948cf22cc66a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b2:4e', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c70bbb-aa56-44fd-b02f-34dc79ed2e5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]
Aug 15 13:24:53 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f427130-8d, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f427130-8d, col_values=(('external_ids', {'iface-id': '1f427130-8d12-496d-b601-58d07da6fbad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:0e:ce', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc197919-f88b-4fd0-a53a-72ce8b22d600]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9c3526-378d-458c-b60b-71bf6d565110]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:53 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8bc7b7-cc04-4042-aa24-99257f02157c]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape91d807f-c2, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape91d807f-c2, col_values=(('external_ids', {'iface-id': 'e91d807f-c2e4-426a-aee6-d06779ef3c41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:d9:86', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:53 user nova-compute[72863]: WARNING nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 for instance with vm_state building and task_state spawning.
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:53 user nova-compute[72863]: WARNING nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 for instance with vm_state building and task_state spawning.
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:53 user nova-compute[72863]: WARNING nova.compute.manager [req-2903a99b-8b65-42ed-a972-2e5736a0bc91 req-9f114ca4-e4c0-41aa-b747-4b7d517061d2 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 for instance with vm_state building and task_state spawning.
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2')
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb12034d7-dd, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb12034d7-dd, col_values=(('external_ids', {'iface-id': 'b12034d7-ddcc-49d7-afa1-948ef30ee323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:7d:91', 'vm-uuid': 'f3de4784-eb7e-4601-a3d4-2f0107849f61'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:53 user nova-compute[72863]: INFO os_vif [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd')
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] No BDM found with device name hda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] No VIF found with MAC fa:16:3e:11:9a:04, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] No VIF found with MAC fa:16:3e:bb:0e:ce, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Using config drive
Aug 15 13:24:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-5316397e-aa55-4f6b-8be7-af572d993028 req-5bb4324a-431a-4f60-9af3-123ab74d2ff1 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:54 user nova-compute[72863]: WARNING nova.compute.manager [req-2ad74b0d-4570-49f8-ac3f-b3bf64e635ad req-725c8401-c61a-4ae5-8f1a-656c92246d5f service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 for instance with vm_state building and task_state spawning.
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.objects.instance [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'flavor' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== connect_volume: return (2590ms) {'type': 'block', 'scsi_wwn': '26639623131643739', 'path': '/dev/sdh'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639623131643739', 'path': '/dev/sdh'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:24:54 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:54 user nova-compute[72863]:   <source dev="/dev/sdh"/>
Aug 15 13:24:54 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:24:54 user nova-compute[72863]:   <serial>04eda795-d566-42e7-bbc8-393bd0b46b93</serial>
Aug 15 13:24:54 user nova-compute[72863]: </disk>
Aug 15 13:24:54 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Creating config drive at /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/disk.config
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8uqf883z {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8uqf883z" returned: 0 in 0.080s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:54 user nova-compute[72863]: INFO nova.compute.manager [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Attaching volume e393d9e8-9e33-42f9-81d1-f30106a61f67 to /dev/sdc
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[420675f7-0547-4c5e-bf05-fa485419f326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0331a9-ccb7-42d9-a74a-eab51963228a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e89a7d-2666-42ee-a58a-5443d4dacaa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787f86f-9935-4bf0-ad61-1d47951e68f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:55 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4cc26-c873-4b7c-a8eb-c6382944b13a]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updating existing volume attachment record: 3cee6b6a-00ec-465c-88a1-00052b1966bc {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No VIF found with MAC fa:16:3e:03:ed:b5, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2a84bb7e-ddc6-41a4-b6bb-369e145d9bca tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.914s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692105880.7422435, 9da5205c-ed07-4087-87b3-1c49f309154a => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:24:55 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] VM Stopped (Lifecycle Event)
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-changed-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Refreshing instance network info cache due to event network-changed-50226385-bc9c-488b-9070-201b266392bf. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] Acquiring lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] Acquired lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Refreshing network info cache for port 50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2a06835c-3a7a-4b6f-b89e-089418f55f9b None None] [instance: 9da5205c-ed07-4087-87b3-1c49f309154a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105896.1865654, 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] VM Resumed (Lifecycle Event)
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance spawned successfully.
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72863) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105896.198396, 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] VM Started (Lifecycle Event)
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:56 user nova-compute[72863]: WARNING nova.compute.manager [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 for instance with vm_state building and task_state spawning.
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-changed-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Refreshing instance network info cache due to event network-changed-960d42e1-6975-4b57-832a-046fd3d3ecb0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Acquiring lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Acquired lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Refreshing network info cache for port 960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Took 12.02 seconds to spawn the instance on the hypervisor.
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updated VIF entry in instance network info cache for port 50226385-bc9c-488b-9070-201b266392bf. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating instance_info_cache with network_info: [{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lazy-loading 'flavor' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12d0d9c9-9187-43cc-8609-4928b39e2af3 req-a1b69fa6-fd92-43fc-990d-66d0e89eee34 service nova] Releasing lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:56 user nova-compute[72863]: INFO nova.compute.manager [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Took 62.01 seconds to build instance.
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86d2808a-1fa8-420b-aa2e-f39d21bcc1f2 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.134s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:57 user nova-compute[72863]: INFO nova.compute.manager [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Attaching volume 4c1df3dc-b43e-46b2-8970-8288858e9f78 to /dev/vdb
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updated VIF entry in instance network info cache for port 960d42e1-6975-4b57-832a-046fd3d3ecb0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updating instance_info_cache with network_info: [{"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcfb1fd-4900-4683-bdad-ad20f9de00a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-181a3410-5bec-47e2-a670-03c1c4007bf8 req-b790688c-d005-42b9-a7fc-8abd3cab9d42 service nova] Releasing lock "refresh_cache-b33fd6c7-9e23-436a-858c-2767f8baf885" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdMvtgUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:24:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:24:57 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df852558-99d7-46db-9057-691d44cb708a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e963c7d5-acfe-42ae-b963-7b75569dd0f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:24:57 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc974fc-00a5-4be2-b5ed-839d5b3f1f21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efe9b99-7055-476a-a6d5-c36928078d9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89783abc-e977-4a49-9d07-6c70e833c064]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395] added
Aug 15 13:24:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:24:57 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b97b7e2-6d59-4ffb-8c7b-c61c93d19414]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updating existing volume attachment record: e22c1fca-52ba-4b76-bb0b-ed767857b75d {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225acf4-af54-461e-b5f7-9ea340fc77bf]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23a5ac8-3a36-48b5-8887-e14187138799]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdMvtgUk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdMvtgUk" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5d689-2777-43cd-a42b-4f14740b104e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdMvtgUk'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6534041-abe9-4618-8a28-cd5ef9c6c9c9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance destroyed successfully.
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332b96f-d816-4c4d-90ae-35dec403ab28]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:57 user nova-compute[72863]: WARNING nova.compute.manager [req-00332447-0875-4436-86b9-599eec8d56ef req-07acc011-baf4-4007-b1d6-f425a4429711 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 for instance with vm_state building and task_state spawning.
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0a102918-158a-4ffd-a467-2cd13a4d3fc1 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.664s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --login" returned: 0 in 0.129s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da843f71-82ca-4142-8d88-3a7c54ffc3dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260]
Aug 15 13:24:57 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260] successful.
Aug 15 13:24:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74de48-7958-44b3-baa6-69de434c7157]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad47f4-d3e5-46b1-af67-5a888f83c159]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:24:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab73798-665d-46e6-9017-2bcc8397e20d]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdMvtgUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:58 user nova-compute[72863]: WARNING nova.compute.manager [req-be13dfa7-090c-4a96-9f54-2fcdc5342c30 req-29a39c36-a9bc-412e-bd14-5a18a7ad614c service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a for instance with vm_state building and task_state spawning.
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:58 user nova-compute[72863]: WARNING nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 for instance with vm_state building and task_state spawning.
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:58 user nova-compute[72863]: WARNING nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 for instance with vm_state building and task_state spawning.
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:58 user nova-compute[72863]: WARNING nova.compute.manager [req-547222cc-bf5f-4c7e-90cd-c0360d26e874 req-3a968655-cf60-4553-a3ea-3d73cbf55e06 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state None.
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.632s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== connect_volume: return (1636ms) {'type': 'block', 'scsi_wwn': '23833373037396536', 'path': '/dev/sdi'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833373037396536', 'path': '/dev/sdi'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:24:59 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:24:59 user nova-compute[72863]:   <source dev="/dev/sdi"/>
Aug 15 13:24:59 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:24:59 user nova-compute[72863]:   <serial>fc33af2d-4882-4984-afe0-65728dc7d395</serial>
Aug 15 13:24:59 user nova-compute[72863]: </disk>
Aug 15 13:24:59 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:59 user nova-compute[72863]: WARNING nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 for instance with vm_state building and task_state spawning.
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:59 user nova-compute[72863]: WARNING nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad for instance with vm_state building and task_state spawning.
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:24:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:24:59 user nova-compute[72863]: WARNING nova.compute.manager [req-4eb2f145-1703-43cf-b990-bf0216bd735b req-beb65427-aefb-41d3-bb6d-42bdd108c0a3 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:0c:62:32, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-912653f3-4888-40cf-8535-abf0ba2b0c13 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.964s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-4de1de13-68f5-429b-b6d0-a8fdbc464611 req-99ba5c38-4ed1-4db6-8298-1cb8fceb3033 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state None.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:00 user nova-compute[72863]: WARNING nova.compute.manager [req-5abd97f4-d0d2-486c-b8c1-a2d0bb5bd7dc req-a94b6f16-beba-4e44-bfdb-a178081d9730 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 for instance with vm_state building and task_state spawning.
Aug 15 13:25:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG nova.objects.instance [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'flavor' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.153s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:02 user nova-compute[72863]: INFO nova.compute.manager [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Attaching volume 16d15726-ecd1-40c2-8059-9765248c1347 to /dev/vdb
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.utils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b2bfc2-a5da-44d7-8b8b-605a943261bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f5b3a-60a2-4060-bfad-d083cf09ad41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b85efd-6cf4-4bee-9b06-53bb862e76d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c7d06-bd12-4123-92a7-1cbaaeb68c8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:02 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b3d47-ecab-4586-ab38-cbd137326539]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG os_brick.utils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating existing volume attachment record: 9d52a0d2-cab2-4a1e-ac9b-e966569d1b33 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:02 user nova-compute[72863]: WARNING nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 for instance with vm_state building and task_state spawning.
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:02 user nova-compute[72863]: WARNING nova.compute.manager [req-9f45d3d5-e0f2-416a-8ffc-962ff0c5285f req-d4eb6af2-9ab9-4a9d-938d-ce8b069aabac service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 for instance with vm_state building and task_state spawning.
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105902.875801, f3de4784-eb7e-4601-a3d4-2f0107849f61 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:02 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] VM Resumed (Lifecycle Event)
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:25:02 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance spawned successfully.
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:02 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:25:02 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105902.88273, f3de4784-eb7e-4601-a3d4-2f0107849f61 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:02 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] VM Started (Lifecycle Event)
Aug 15 13:25:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:25:03 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:25:03 user nova-compute[72863]: INFO nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Took 15.80 seconds to spawn the instance on the hypervisor.
Aug 15 13:25:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:03 user nova-compute[72863]: INFO nova.compute.manager [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Took 60.34 seconds to build instance.
Aug 15 13:25:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8668b908-209e-48e0-bb5c-e59a1e46af61 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.450s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:25:04 user nova-compute[72863]: INFO nova.compute.claims [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Claim successful on node user
Aug 15 13:25:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-changed-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Refreshing instance network info cache due to event network-changed-054d7665-62e7-4bac-9741-1917b3e1c35d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] Acquiring lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] Acquired lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Refreshing network info cache for port 054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:25:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:25:04 user nova-compute[72863]: DEBUG nova.policy [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e68128a64baa4eb89f1454f94115ae1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f776a79a5746ae840d47da420daedc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:25:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Creating image(s)
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "/opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.202s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updated VIF entry in instance network info cache for port 054d7665-62e7-4bac-9741-1917b3e1c35d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updating instance_info_cache with network_info: [{"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2bb5fab0-6ec1-441e-a28e-ab62ae3e3f26 req-9ad3c9cd-9d3c-4c1d-bf10-5b7fd4484b5c service nova] Releasing lock "refresh_cache-72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk 1073741824" returned: 0 in 0.163s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.209s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Successfully created port: d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Cannot resize image /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.objects.instance [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'migration_context' on Instance uuid c50059af-8a64-4b01-98e2-2236cb4f958d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Ensure instance console log exists: /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Successfully updated port: d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquired lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-changed-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Refreshing instance network info cache due to event network-changed-d35084d7-08f9-40d2-9f40-24a4abd65953. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] Acquiring lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updating instance_info_cache with network_info: [{"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Releasing lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Instance network_info: |[{"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] Acquired lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Refreshing network info cache for port d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Start _get_guest_xml network_info=[{"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:25:07 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:25:07 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1617760626',display_name='tempest-AttachVolumeNegativeTest-server-1617760626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1617760626',id=12,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYrxUZzX5tPGtlbkx36jppfZ0ZbFFH4PxoPvrizr37H3m/sJHno+4RwEX8zp8e4KuUNMnjEQE4ov8j8Ovw0Iwgxya6tUg9DCQ0lNTznJmgtJGywf6hsAzis5ZXH19R/uw==',key_name='tempest-keypair-934298311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-pc4z13ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=c50059af-8a64-4b01-98e2-2236cb4f958d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'pci_devices' on Instance uuid c50059af-8a64-4b01-98e2-2236cb4f958d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:25:07 user nova-compute[72863]:   <uuid>c50059af-8a64-4b01-98e2-2236cb4f958d</uuid>
Aug 15 13:25:07 user nova-compute[72863]:   <name>instance-0000000c</name>
Aug 15 13:25:07 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:25:07 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:25:07 user nova-compute[72863]:   <metadata>
Aug 15 13:25:07 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:25:07 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1617760626</nova:name>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:25:07</nova:creationTime>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:25:07 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:25:07 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:owner>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:user uuid="e68128a64baa4eb89f1454f94115ae1c">tempest-AttachVolumeNegativeTest-1688916020-project-member</nova:user>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:project uuid="67f776a79a5746ae840d47da420daedc">tempest-AttachVolumeNegativeTest-1688916020</nova:project>
Aug 15 13:25:07 user nova-compute[72863]:       </nova:owner>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:25:07 user nova-compute[72863]:       <nova:ports>
Aug 15 13:25:07 user nova-compute[72863]:         <nova:port uuid="d35084d7-08f9-40d2-9f40-24a4abd65953">
Aug 15 13:25:07 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 13:25:07 user nova-compute[72863]:         </nova:port>
Aug 15 13:25:07 user nova-compute[72863]:       </nova:ports>
Aug 15 13:25:07 user nova-compute[72863]:     </nova:instance>
Aug 15 13:25:07 user nova-compute[72863]:   </metadata>
Aug 15 13:25:07 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:25:07 user nova-compute[72863]:     <system>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="serial">c50059af-8a64-4b01-98e2-2236cb4f958d</entry>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="uuid">c50059af-8a64-4b01-98e2-2236cb4f958d</entry>
Aug 15 13:25:07 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:25:07 user nova-compute[72863]:     </system>
Aug 15 13:25:07 user nova-compute[72863]:   </sysinfo>
Aug 15 13:25:07 user nova-compute[72863]:   <os>
Aug 15 13:25:07 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:25:07 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:25:07 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:25:07 user nova-compute[72863]:   </os>
Aug 15 13:25:07 user nova-compute[72863]:   <features>
Aug 15 13:25:07 user nova-compute[72863]:     <acpi/>
Aug 15 13:25:07 user nova-compute[72863]:     <apic/>
Aug 15 13:25:07 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:25:07 user nova-compute[72863]:   </features>
Aug 15 13:25:07 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:25:07 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:25:07 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:25:07 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:25:07 user nova-compute[72863]:   </clock>
Aug 15 13:25:07 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:25:07 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:25:07 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:25:07 user nova-compute[72863]:   </cpu>
Aug 15 13:25:07 user nova-compute[72863]:   <devices>
Aug 15 13:25:07 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:25:07 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:25:07 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk"/>
Aug 15 13:25:07 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:25:07 user nova-compute[72863]:     </disk>
Aug 15 13:25:07 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:25:07 user nova-compute[72863]:       <mac address="fa:16:3e:b2:ab:a8"/>
Aug 15 13:25:07 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:25:07 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:25:07 user nova-compute[72863]:       <target dev="tapd35084d7-08"/>
Aug 15 13:25:07 user nova-compute[72863]:     </interface>
Aug 15 13:25:07 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:25:07 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/console.log" append="off"/>
Aug 15 13:25:07 user nova-compute[72863]:     </serial>
Aug 15 13:25:07 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:25:07 user nova-compute[72863]:     <video>
Aug 15 13:25:07 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:25:07 user nova-compute[72863]:     </video>
Aug 15 13:25:07 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:25:07 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:25:07 user nova-compute[72863]:     </rng>
Aug 15 13:25:07 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:25:07 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:25:07 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:25:07 user nova-compute[72863]:     </memballoon>
Aug 15 13:25:07 user nova-compute[72863]:   </devices>
Aug 15 13:25:07 user nova-compute[72863]: </domain>
Aug 15 13:25:07 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1617760626',display_name='tempest-AttachVolumeNegativeTest-server-1617760626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1617760626',id=12,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYrxUZzX5tPGtlbkx36jppfZ0ZbFFH4PxoPvrizr37H3m/sJHno+4RwEX8zp8e4KuUNMnjEQE4ov8j8Ovw0Iwgxya6tUg9DCQ0lNTznJmgtJGywf6hsAzis5ZXH19R/uw==',key_name='tempest-keypair-934298311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-pc4z13ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=c50059af-8a64-4b01-98e2-2236cb4f958d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG os_vif [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd35084d7-08, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd35084d7-08, col_values=(('external_ids', {'iface-id': 'd35084d7-08f9-40d2-9f40-24a4abd65953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ab:a8', 'vm-uuid': 'c50059af-8a64-4b01-98e2-2236cb4f958d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:07 user nova-compute[72863]: INFO os_vif [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08')
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:b2:ab:a8, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updated VIF entry in instance network info cache for port d35084d7-08f9-40d2-9f40-24a4abd65953. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updating instance_info_cache with network_info: [{"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-320e969f-128d-41e5-8880-d948fa12909b req-0cd194c5-87a5-48b2-b586-0f607d5ed390 service nova] Releasing lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] No waiting events found dispatching network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:09 user nova-compute[72863]: WARNING nova.compute.manager [req-6f8ca1a5-aada-4bdc-b497-ea2895e71df4 req-c80d5404-ac46-4ccc-b946-197f5c27d6fb service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received unexpected event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 for instance with vm_state building and task_state spawning.
Aug 15 13:25:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeqMZDSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:09 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:09 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:09 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[181899c3-9012-4de6-9095-d79eb6fd9cb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:09 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e750f-adb4-4ea5-a294-47e72dc3615a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67] added
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a60916-0e5d-4b03-bc86-b7e3e7f5202f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2da32c-8403-46eb-bba3-806045e32c5e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeqMZDSJ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeqMZDSJ" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[920242a7-a28d-4983-80a9-f6f392fcc4cc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeqMZDSJ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6dc92-6972-4435-bccf-32aed8f7f4fe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7fe9a-57b1-421e-8792-99e5c9f9d64d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'flavor' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df76a72-48a7-4165-8106-73ec938b3f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260]
Aug 15 13:25:09 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ba489-4886-4b03-948c-dfc65edc96ce]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ae4b8b-5fa5-4143-b416-a52b6f1aeedb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef4f22-9726-491e-838e-1cdf8e6f8c95]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeqMZDSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:10 user nova-compute[72863]: INFO nova.compute.manager [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attaching volume 4a131344-4247-4e54-83e7-6766bd94c850 to /dev/vdb
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.utils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8528e1-fd11-4f89-bf30-835b14a39968]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a00408-724f-4976-a36c-8405ae595d1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff3f7f-e82a-4650-8ad6-6c25809f0332]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60807199-9b00-4203-9ce8-eef5b1cb6c1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:10 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[604acf72-2852-4197-a96e-97b82c6ea16b]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.utils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updating existing volume attachment record: 5e5538e5-0762-442a-91b2-1012f49a2138 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.562s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] <== connect_volume: return (1565ms) {'type': 'block', 'scsi_wwn': '23836346431663662', 'path': '/dev/sdj'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836346431663662', 'path': '/dev/sdj'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.objects.instance [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'flavor' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:25:11 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:11 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:25:11 user nova-compute[72863]:   <target dev="sdc" bus="scsi"/>
Aug 15 13:25:11 user nova-compute[72863]:   <serial>e393d9e8-9e33-42f9-81d1-f30106a61f67</serial>
Aug 15 13:25:11 user nova-compute[72863]:   <address type="drive" controller="0" unit="2"/>
Aug 15 13:25:11 user nova-compute[72863]: </disk>
Aug 15 13:25:11 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAOjSvTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:11 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0629dc-697b-4191-a7b0-81d5550ec42c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:11 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd705b9d-d7d6-4b84-b9da-30a596995010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78] added
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3b366-bf8e-4047-a381-902a78ece0b5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fb75ab-c5ed-4ee2-9348-4cdc1f7a7e66]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAOjSvTY {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAOjSvTY" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272fce0-a667-4c58-8bca-8475b95765e7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAOjSvTY'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b9423-d817-42b0-8c98-ca0d3acbf564]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5702ee09-72b1-4d0f-8ee6-eaa854515681]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] No waiting events found dispatching network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:11 user nova-compute[72863]: WARNING nova.compute.manager [req-664dff00-2f19-419b-9aa8-80fd8bd341e6 req-ab31f306-2ba9-4df6-85f7-e2f60246fbc4 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received unexpected event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 for instance with vm_state building and task_state spawning.
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed83a54-3ef1-4648-932a-b3bacdc36f86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260]
Aug 15 13:25:11 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c66d35-68ee-406c-8c03-e5e29dda0f9e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ece011-4a2d-4eca-9657-9137e8ae3104]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb97b21a-5184-4dbb-9f0b-e65f6b007b9c]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAOjSvTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105911.6816688, c50059af-8a64-4b01-98e2-2236cb4f958d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] VM Resumed (Lifecycle Event)
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Instance spawned successfully.
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No BDM found with device name sda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] No VIF found with MAC fa:16:3e:7f:5f:ab, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105911.6830633, c50059af-8a64-4b01-98e2-2236cb4f958d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] VM Started (Lifecycle Event)
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:25:11 user nova-compute[72863]: INFO nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 15 13:25:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01df3b8d-9e14-4304-b319-6e684599e0de tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.114s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:12 user nova-compute[72863]: INFO nova.compute.manager [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Took 7.97 seconds to build instance.
Aug 15 13:25:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-643fd2b0-5315-4d3d-bf48-f513937b4f66 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.098s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '26433613937663635', 'path': '/dev/sdk'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433613937663635', 'path': '/dev/sdk'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lazy-loading 'flavor' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 13:25:12 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:12 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:12 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:12 user nova-compute[72863]:   <serial>4c1df3dc-b43e-46b2-8970-8288858e9f78</serial>
Aug 15 13:25:12 user nova-compute[72863]: </disk>
Aug 15 13:25:12 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692105897.7593892, 86c46771-bc19-4440-9ed1-d713a003b231 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:12 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Stopped (Lifecycle Event)
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0b4e18a5-b0a1-4d68-a037-d171a4bcec5a None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0b4e18a5-b0a1-4d68-a037-d171a4bcec5a None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] No VIF found with MAC fa:16:3e:48:cc:6b, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7efc5cbe-138a-42d3-ae49-fbc600a84fbe tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.240s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:13 user nova-compute[72863]: INFO nova.compute.manager [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Detaching volume e393d9e8-9e33-42f9-81d1-f30106a61f67
Aug 15 13:25:13 user nova-compute[72863]: INFO nova.virt.block_device [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Attempting to driver detach volume e393d9e8-9e33-42f9-81d1-f30106a61f67 from mountpoint /dev/sdc
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Attempting to detach device sdc from instance f48d3dd5-fb94-4688-bbbb-375136f04c76 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:13 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:13 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:25:13 user nova-compute[72863]:   <target dev="sdc" bus="scsi"/>
Aug 15 13:25:13 user nova-compute[72863]:   <serial>e393d9e8-9e33-42f9-81d1-f30106a61f67</serial>
Aug 15 13:25:13 user nova-compute[72863]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 13:25:13 user nova-compute[72863]: </disk>
Aug 15 13:25:13 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Successfully detached device sdc from instance f48d3dd5-fb94-4688-bbbb-375136f04c76 from the persistent domain config.
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f48d3dd5-fb94-4688-bbbb-375136f04c76 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:25:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:13 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:13 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:25:13 user nova-compute[72863]:   <target dev="sdc" bus="scsi"/>
Aug 15 13:25:13 user nova-compute[72863]:   <serial>e393d9e8-9e33-42f9-81d1-f30106a61f67</serial>
Aug 15 13:25:13 user nova-compute[72863]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 13:25:13 user nova-compute[72863]: </disk>
Aug 15 13:25:13 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] volume_snapshot_create: create_info: {'snapshot_id': 'b51d0566-e903-4160-8c38-5ed94a1b8355', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72863) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] snap xml: <domainsnapshot>
Aug 15 13:25:14 user nova-compute[72863]:   <disks>
Aug 15 13:25:14 user nova-compute[72863]:     <disk name="/dev/sdk" snapshot="external" type="file">
Aug 15 13:25:14 user nova-compute[72863]:       <source file="/dev/new_file"/>
Aug 15 13:25:14 user nova-compute[72863]:     </disk>
Aug 15 13:25:14 user nova-compute[72863]:     <disk name="vda" snapshot="no"/>
Aug 15 13:25:14 user nova-compute[72863]:   </disks>
Aug 15 13:25:14 user nova-compute[72863]: </domainsnapshot>
Aug 15 13:25:14 user nova-compute[72863]:  {{(pid=72863) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lazy-loading 'system_metadata' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692105914.2440102, f48d3dd5-fb94-4688-bbbb-375136f04c76 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:25:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Successfully detached device sdc from instance f48d3dd5-fb94-4688-bbbb-375136f04c76 from the live domain config.
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeqMZDSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:14 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0feb277a-55d1-42b5-9c1b-56feaf3db839 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] volume_snapshot_delete: delete_info: {'volume_id': '4c1df3dc-b43e-46b2-8970-8288858e9f78'} {{(pid=72863) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [None req-0feb277a-55d1-42b5-9c1b-56feaf3db839 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     if delete_info['type'] != 'qcow2':
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] KeyError: 'type'
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98a6f2-8efc-413f-8bcf-64653e4f8d61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     rv = execute(f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     six.reraise(c, e, tb)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     raise value
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     rv = meth(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     self._volume_snapshot_create(context, instance, guest,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     rv = execute(f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     six.reraise(c, e, tb)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     raise value
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     rv = meth(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ae558-8197-455a-b9a0-be922539f78b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c7039a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67'): ({'sdj'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Removing single pathed devices sdj {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb38d9-139f-4a26-abb3-2f66a3a84ca4]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [None req-0feb277a-55d1-42b5-9c1b-56feaf3db839 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-aad3c845-ced9-438d-859c-cb45064f10e5)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[64acaf9d-7375-484f-8baa-c3a1fa23ad26]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Flushing IO for device /dev/sdj {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server [None req-0feb277a-55d1-42b5-9c1b-56feaf3db839 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[837fd46f-ce04-4043-ab33-8075bf00f306]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.056s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d85feb-aff3-43dd-99a9-cab543011bef]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b51d0566-e903-4160-8c38-5ed94a1b8355 could not be found.
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b51d0566-e903-4160-8c38-5ed94a1b8355 could not be found. (HTTP 404) (Request-ID: req-eb067a6a-4ffc-49ea-a4c1-fa9194656bf9)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b51d0566-e903-4160-8c38-5ed94a1b8355 could not be found.
Aug 15 13:25:14 user nova-compute[72863]: ERROR nova.virt.libvirt.driver 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server [None req-5d11a360-0c8a-4076-aae2-7c67c167520b tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 13:25:14 user nova-compute[72863]: ERROR oslo_messaging.rpc.server 
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52d849-cf65-4f4f-823c-908c100c7f63]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8e3467-6703-4078-9f4c-9d6bff7e62cb]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260]
Aug 15 13:25:14 user nova-compute[72863]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e393d9e8-9e33-42f9-81d1-f30106a61f67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba87f68-e972-407d-8f55-5d387bc44a7f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] <== disconnect_volume: return (559ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:15 user nova-compute[72863]: INFO nova.compute.manager [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Detaching volume 4c1df3dc-b43e-46b2-8970-8288858e9f78
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'flavor' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-74c1afd3-a8ec-4e52-b07e-d0066e87bdb9 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.583s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: INFO nova.virt.block_device [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Attempting to driver detach volume 4c1df3dc-b43e-46b2-8970-8288858e9f78 from mountpoint /dev/vdb
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Attempting to detach device vdb from instance b33fd6c7-9e23-436a-858c-2767f8baf885 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:16 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:16 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:16 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:16 user nova-compute[72863]:   <serial>4c1df3dc-b43e-46b2-8970-8288858e9f78</serial>
Aug 15 13:25:16 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:16 user nova-compute[72863]: </disk>
Aug 15 13:25:16 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Successfully detached device vdb from instance b33fd6c7-9e23-436a-858c-2767f8baf885 from the persistent domain config.
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b33fd6c7-9e23-436a-858c-2767f8baf885 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:16 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:16 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:16 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:16 user nova-compute[72863]:   <serial>4c1df3dc-b43e-46b2-8970-8288858e9f78</serial>
Aug 15 13:25:16 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:16 user nova-compute[72863]: </disk>
Aug 15 13:25:16 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:16 user nova-compute[72863]: INFO nova.compute.manager [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Terminating instance
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692105916.814411, b33fd6c7-9e23-436a-858c-2767f8baf885 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:25:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Successfully detached device vdb from instance b33fd6c7-9e23-436a-858c-2767f8baf885 from the live domain config.
Aug 15 13:25:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAOjSvTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:16 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f33acdb-1fb1-4c28-810f-06ad15476dec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0246cab-6ecd-4221-8c76-d6a87618572a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:16 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78'): ({'sdk'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Removing single pathed devices sdk {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b3480-3ef9-47c0-b88b-5fe1966ff934]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92c66c0-a7e6-4b89-a139-f1d911a6cc51]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Flushing IO for device /dev/sdk {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a2c18f-46c9-4516-9758-c70ad9ad8885]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b75ce-bde0-4d03-ac5f-f61689b11e91]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4046cbe-de19-4e6d-b8e0-b657ea9c7459]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-unplugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] No waiting events found dispatching network-vif-unplugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-b64b8ec6-0dac-492c-b5d9-f2f8a66bbc5e req-57e1a43e-d1ff-4299-bf3f-d7d8e506d86a service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-unplugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57679e58-6c5e-458e-9774-889ed4a7c0df]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260]
Aug 15 13:25:17 user nova-compute[72863]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:17 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1df3dc-b43e-46b2-8970-8288858e9f78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e155c13-d2f7-4d9d-a74c-5c8b32e040a7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] <== disconnect_volume: return (533ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Instance destroyed successfully.
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.objects.instance [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lazy-loading 'resources' on Instance uuid f48d3dd5-fb94-4688-bbbb-375136f04c76 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-413236999',display_name='tempest-AttachSCSIVolumeTestJSON-server-413236999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-413236999',id=5,image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZZhT7s6iiR++1X/elxodUTKnH5220R24huCfcvLC3GkLJKA4sYmewntiZxva1AXza4w35udWmrzxruWQObU/VKEBH0UgNAj4Q/9ag/fdub6/RILfKqS5adF94Ozv+RA==',key_name='tempest-keypair-1103316038',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:23:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='323ea5da06254ef4b04d4dc14f6e474a',ramdisk_id='',reservation_id='r-brmne2ua',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86b907c3-8fe3-4b0d-b216-dcca8045e60c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1377483256',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1377483256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:23:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd81e75837b643a88dfd40c25402334e',uuid=f48d3dd5-fb94-4688-bbbb-375136f04c76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converting VIF {"id": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "address": "fa:16:3e:7f:5f:ab", "network": {"id": "db32f3f5-0278-442c-ad30-e06aa3284593", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-936627880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323ea5da06254ef4b04d4dc14f6e474a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ab38b6-a2", "ovs_interfaceid": "f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG os_vif [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3ab38b6-a2, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:17 user nova-compute[72863]: INFO os_vif [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5f:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773,network=Network(db32f3f5-0278-442c-ad30-e06aa3284593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ab38b6-a2')
Aug 15 13:25:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Deleting instance files /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76_del
Aug 15 13:25:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Deletion of /opt/stack/data/nova/instances/f48d3dd5-fb94-4688-bbbb-375136f04c76_del complete
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:17 user nova-compute[72863]: INFO nova.compute.manager [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 15 13:25:17 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:25:17 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lazy-loading 'flavor' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29f7fde4-5cf7-49e8-ba01-2e5686cfa842 tempest-VolumesAssistedSnapshotsTest-142475701 tempest-VolumesAssistedSnapshotsTest-142475701-project-admin] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.434s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:18 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:18 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Took 1.07 seconds to deallocate network for instance.
Aug 15 13:25:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] Acquiring lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] No waiting events found dispatching network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:25:19 user nova-compute[72863]: WARNING nova.compute.manager [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received unexpected event network-vif-plugged-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 for instance with vm_state deleted and task_state None.
Aug 15 13:25:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-52be8679-877a-4d4d-b832-6373d8462407 req-55a260d2-ffd3-4d19-8d40-da021436782e service nova] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Received event network-vif-deleted-f3ab38b6-a2d7-4c1e-b9e5-e06fe9426773 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:25:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:25:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6958MB free_disk=25.81743621826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:25:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.459s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:20 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Deleted allocations for instance f48d3dd5-fb94-4688-bbbb-375136f04c76
Aug 15 13:25:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dbb0628d-8e44-4b70-ad09-2b8fd38a8a37 tempest-AttachSCSIVolumeTestJSON-1377483256 tempest-AttachSCSIVolumeTestJSON-1377483256-project-member] Lock "f48d3dd5-fb94-4688-bbbb-375136f04c76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.588s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b33fd6c7-9e23-436a-858c-2767f8baf885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e797292e-bcd5-427c-bbfc-c35031f648e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c50059af-8a64-4b01-98e2-2236cb4f958d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:25:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating instance_info_cache with network_info: [{"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-8518b46b-8053-41e4-9c1f-9b4215965ddc" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:23 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:23 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:23 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBeZtLns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:23 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e90df0-ac2b-4879-8605-1f2353f666fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:23 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9584c867-2dd8-43d3-8b43-e879988d9b39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850] added
Aug 15 13:25:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea70a1-8dd4-4a07-baf5-1a10e09e3f1a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf9de5-9803-470b-adb5-3cf4ef02ad6e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJTVQgOh {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJTVQgOh" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82592643-d570-4e1f-a09c-b7b9fc31334e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJTVQgOh'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7d023-4b44-439d-baf8-ee9442930bba]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46750a78-ff88-48de-9b0a-b88f7fd0be34]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f752a7b-be8c-4936-b809-cac80b2fca68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]
Aug 15 13:25:23 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35893e48-2550-4671-ab4f-c1cc40c94933]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0355a3-5179-4088-bf44-526f4994f821]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d770f-ce2a-4b2f-a30c-00dc07fe8f3d]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23636336534336362', 'path': '/dev/sdj'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636336534336362', 'path': '/dev/sdj'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.389s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:25 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:25 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'flavor' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5fa37-4ba3-4377-9fba-d30f2922b854]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:25 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d42c8-cd8a-4819-abe1-ec136ef48884]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347] added
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:25:25 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:25 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:25:25 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:25 user nova-compute[72863]:   <serial>4a131344-4247-4e54-83e7-6766bd94c850</serial>
Aug 15 13:25:25 user nova-compute[72863]: </disk>
Aug 15 13:25:25 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d80e7-cd58-4ed0-a507-9c4e054fc3dd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b624b-0bdd-445f-b71b-33778a67fef2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBeZtLns {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBeZtLns" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee211e1-f43b-4c13-8ffb-1ff4c954e904]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aBeZtLns'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe887b0-3acd-45ef-834d-4105675b70d9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70364992-df03-4a0c-8068-607020c40411]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa28a00-e5a4-49c5-99ed-13a93aee3c6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260]
Aug 15 13:25:25 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad542476-0ea0-4398-864a-1f513590704f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441c7fd-c47f-4666-9e97-af7a91d90ad9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.126s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13b8e4-5d2e-43df-b16c-b9f857355395]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBeZtLns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] No VIF found with MAC fa:16:3e:85:74:4d, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-changed-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Refreshing instance network info cache due to event network-changed-66d323ba-5273-4b45-b683-270ec1ef916b. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] Acquiring lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] Acquired lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Refreshing network info cache for port 66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:25:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9598e65b-d903-493a-aeca-8a4b1cc6b164 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.515s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG nova.network.neutron [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updated VIF entry in instance network info cache for port 66d323ba-5273-4b45-b683-270ec1ef916b. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG nova.network.neutron [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updating instance_info_cache with network_info: [{"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f35ae423-689e-41e1-b044-7442c4e83715 req-13975b00-dbdd-4d03-bcb4-287e728cbb93 service nova] Releasing lock "refresh_cache-e797292e-bcd5-427c-bbfc-c35031f648e5" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] <== connect_volume: return (2882ms) {'type': 'block', 'scsi_wwn': '23435383962303163', 'path': '/dev/sdk'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435383962303163', 'path': '/dev/sdk'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG nova.objects.instance [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'flavor' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:25:26 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:26 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:26 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:26 user nova-compute[72863]:   <serial>16d15726-ecd1-40c2-8059-9765248c1347</serial>
Aug 15 13:25:26 user nova-compute[72863]: </disk>
Aug 15 13:25:26 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c6078-f5a1-48b1-bd76-4b89bb68617d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d76726-5a56-45e2-ad9f-d3221cedf6b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed42864-2013-4091-8b85-fb5618c2d131]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4fc2b1-a644-4463-af0c-9e85c15766e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:26 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd00ba-ba92-477f-ae5c-5bea79377df1]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:27 user nova-compute[72863]: INFO nova.compute.manager [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Swapping volume 4a131344-4247-4e54-83e7-6766bd94c850 for e46f679f-c7c0-418c-b60d-acda73a2d720
Aug 15 13:25:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No VIF found with MAC fa:16:3e:6b:ca:51, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05a15c54-b399-4570-be39-a69005e6f852 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.043s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:28 user nova-compute[72863]: INFO nova.compute.manager [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Detaching volume 16d15726-ecd1-40c2-8059-9765248c1347
Aug 15 13:25:28 user nova-compute[72863]: INFO nova.virt.block_device [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Attempting to driver detach volume 16d15726-ecd1-40c2-8059-9765248c1347 from mountpoint /dev/vdb
Aug 15 13:25:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Attempting to detach device vdb from instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:25:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:28 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:28 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:28 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:28 user nova-compute[72863]:   <serial>16d15726-ecd1-40c2-8059-9765248c1347</serial>
Aug 15 13:25:28 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:28 user nova-compute[72863]: </disk>
Aug 15 13:25:28 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully detached device vdb from instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 from the persistent domain config.
Aug 15 13:25:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:25:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:28 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:28 user nova-compute[72863]:   <source dev="/dev/sdk"/>
Aug 15 13:25:28 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:28 user nova-compute[72863]:   <serial>16d15726-ecd1-40c2-8059-9765248c1347</serial>
Aug 15 13:25:28 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:28 user nova-compute[72863]: </disk>
Aug 15 13:25:28 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692105929.2907684, fcac4ae5-a862-496e-b30f-b4c73bcc3368 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:25:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully detached device vdb from instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 from the live domain config.
Aug 15 13:25:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBeZtLns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:29 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ce141-4a18-4e96-944b-ee7d599a1a1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae8ea35-ff6f-4f86-929a-3c3496680b30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:29 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c54ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347'): ({'sdk'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Removing single pathed devices sdk {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8d0c6-7e2b-4d83-b94e-828c526befe3]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[150937e7-6735-44ab-8c23-d196cc399c71]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Flushing IO for device /dev/sdk {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9cdc28-7bfa-4400-8508-ad2376804154]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e126cf3-e42f-4b4b-88a8-c22b766e5b22]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0be02-17c3-4567-baf6-89ab71a0f49a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a87d9-e91b-488f-bc0e-847a83b6a952]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260]
Aug 15 13:25:29 user nova-compute[72863]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:29 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16d15726-ecd1-40c2-8059-9765248c1347 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d05c1-468d-4a76-bf1d-4c6972a04279]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] <== disconnect_volume: return (356ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'flavor' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'flavor' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e21c2f15-90cd-4e3b-97bc-d0528bf00e86 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.777s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:30 user nova-compute[72863]: INFO nova.compute.manager [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Attaching volume bc54c393-1604-40c7-997e-ff083bdefadf to /dev/vdb
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.utils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec592c65-7f69-411f-adac-8dd041cb4c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad315a-9ea4-45f0-9801-882dc7de79db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7238c8-91f8-43e2-8b8e-b9b13669cefe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2afb9d8-02f4-41cd-9f45-4405eb59a0c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:30 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7faa343-898a-4acf-8c72-584e2d720985]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG os_brick.utils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:30 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updating existing volume attachment record: 788ab1a1-ea5b-457b-ad16-b4007e657715 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:25:32 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692105917.6574678, f48d3dd5-fb94-4688-bbbb-375136f04c76 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:25:32 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] VM Stopped (Lifecycle Event)
Aug 15 13:25:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-39a43d4b-d4db-4395-8d16-215492025e5e None None] [instance: f48d3dd5-fb94-4688-bbbb-375136f04c76] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:25:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "7d63a9af-b303-4b93-ac3e-8bd2ddf582db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "7d63a9af-b303-4b93-ac3e-8bd2ddf582db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:25:35 user nova-compute[72863]: INFO nova.compute.claims [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Claim successful on node user
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:25:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:25:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:25:36 user nova-compute[72863]: INFO nova.virt.block_device [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Booting with blank volume at /dev/vda
Aug 15 13:25:36 user nova-compute[72863]: DEBUG nova.policy [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f28612e758464797a56a4b7ea233ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e9e6721b634d2fb974f7a10c6e0359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:25:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Successfully created port: bf7e4c2a-abc3-4441-8608-07627ee15e1c {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Successfully updated port: bf7e4c2a-abc3-4441-8608-07627ee15e1c {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Received event network-changed-bf7e4c2a-abc3-4441-8608-07627ee15e1c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Refreshing instance network info cache due to event network-changed-bf7e4c2a-abc3-4441-8608-07627ee15e1c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] Acquiring lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Updating instance_info_cache with network_info: [{"id": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "address": "fa:16:3e:9b:a5:a9", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7e4c2a-ab", "ovs_interfaceid": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Instance network_info: |[{"id": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "address": "fa:16:3e:9b:a5:a9", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7e4c2a-ab", "ovs_interfaceid": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] Acquired lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Refreshing network info cache for port bf7e4c2a-abc3-4441-8608-07627ee15e1c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720', 'serial': 'e46f679f-c7c0-418c-b60d-acda73a2d720'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '4a131344-4247-4e54-83e7-6766bd94c850', 'serial'} {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:37 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4680e-26c2-4f01-bbd1-53b720f72497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:37 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac64e1-4c7c-4a08-8644-823789f216d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720] added
Aug 15 13:25:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c30ba-429d-4269-baa0-df7b641510c9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc80b40-451f-46b8-a3dd-fe55893697ca]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjYuMNRH {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjYuMNRH" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1652fe9-702e-4048-aac0-44aba92353cf]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjYuMNRH'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d3ccb1-47ce-4310-b2e1-2d42d0994351]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a173537-6dbf-45e1-ba8d-63ad8117266e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ccc82f-f132-4aea-8981-92284f18bbaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260]
Aug 15 13:25:38 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e40d97-b9fd-44c2-badf-dd8aa13751de]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b0347-a2ad-4985-b2e6-6370ec43f1b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Updated VIF entry in instance network info cache for port bf7e4c2a-abc3-4441-8608-07627ee15e1c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Updating instance_info_cache with network_info: [{"id": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "address": "fa:16:3e:9b:a5:a9", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7e4c2a-ab", "ovs_interfaceid": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03227c7-66ba-4db5-818c-fc2e39dc00c7]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21f1b42-e020-4edf-b822-3145f4fd5b9a req-6ca361e4-27ac-452a-9a3e-3dca7407091d service nova] Releasing lock "refresh_cache-7d63a9af-b303-4b93-ac3e-8bd2ddf582db" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23965346436623536', 'path': '/dev/sdk'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965346436623536', 'path': '/dev/sdk'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lazy-loading 'flavor' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 493879296 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 653262848 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG os_brick.utils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b6d88e-67e1-4e80-ac4d-bf9221a8f879]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c89e91-4695-4cb3-902e-29e2fb421e0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a77e5fd-b525-4d48-ad13-ad6c0bdd4499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc2893-40ee-4e69-a290-c60570c4054c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:42 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0211bca5-2e5d-46c1-84ba-3aeda8a17863]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG os_brick.utils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Updating existing volume attachment record: 550414a4-62c1-4e12-a609-8651f6d51d64 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 821035008 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 981467136 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roKBHnOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:43 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c6d72-c063-4d7f-9dbf-449dba38f5c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:43 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[028555da-6a0e-4bb9-b303-aab75238354c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf] added
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a37878-4fc8-440b-b524-0b49198ad8de]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fb9c5-a02e-4e27-9466-77e81f17b61a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roKBHnOl {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roKBHnOl" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7c495-fea5-4dc8-b3e6-30ddcb727d7e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roKBHnOl'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2c34e-96cf-46ff-9837-1179c4f9a69c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9c4dff-dea4-4d60-8c77-e43a1683e69a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f14601-2b17-41da-8f50-86fbbc6900dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260]
Aug 15 13:25:43 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ed250-62d6-4f24-ae17-3445f32e9a39]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[36701d6e-eb3d-4856-b03e-d5ecda9bf6ee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] HCTL ('43', '-', '-', 0) found on session 16 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6ee5db-8ab6-4eb9-9805-c0b38d5c3916]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Searching for a device in session 16 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Connected to sdl using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roKBHnOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23164343035663834', 'path': '/dev/sdl'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343035663834', 'path': '/dev/sdl'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.057s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'flavor' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3091245-f311-4d1f-9f8d-d8c54defd0da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:25:44 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:44 user nova-compute[72863]:   <source dev="/dev/sdl"/>
Aug 15 13:25:44 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:44 user nova-compute[72863]:   <serial>bc54c393-1604-40c7-997e-ff083bdefadf</serial>
Aug 15 13:25:44 user nova-compute[72863]: </disk>
Aug 15 13:25:44 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dacf2e-8bcb-448c-aebe-02a66d55a07d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff52407a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'): ({'sdj'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Removing single pathed devices sdj {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8162df6b-6496-435e-9d91-82b6b9e5439a]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf497d-b796-4f10-b803-d1e0e419e9bf]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Flushing IO for device /dev/sdj {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77381cde-fb0c-4324-8d0e-ea95d33dc53e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc0f58-2ba1-4788-aa93-25d780fc3ee9]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[566919c4-1e4f-4e61-abc8-70df343f5c86]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f98a11-5808-47c8-9fa8-0117f4dd3a31]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]
Aug 15 13:25:44 user nova-compute[72863]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:44 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[545c4ad9-34ee-4019-82fb-a51044ec7617]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== disconnect_volume: return (1438ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720', 'serial'} {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: removing Cinder connection for volume 4a131344-4247-4e54-83e7-6766bd94c850 {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] No VIF found with MAC fa:16:3e:ab:7b:c5, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c9b338cb-daad-43fc-b16b-314c198b3547 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.614s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: Updating volume 4a131344-4247-4e54-83e7-6766bd94c850 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "kjYuMNRH", "auth_password": "EF0sGudWR9M4ZK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "e46f679f-c7c0-418c-b60d-acda73a2d720"}, "status": "reserved", "instance": "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d", "attached_at": "", "detached_at": "", "volume_id": "e46f679f-c7c0-418c-b60d-acda73a2d720", "serial": "e46f679f-c7c0-418c-b60d-acda73a2d720"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720', 'no_device': None, 'attachment_id': '8a75b579-6915-40da-b40f-cd4bc6655cec'} {{(pid=72863) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ef69f136-8dbb-4ed5-8dea-96934b1a11e7 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.205s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.utils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff117a5d-b4e3-44f6-857e-6adbd8ee05be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217a86f-1107-4d3b-8aeb-45a04f9d2da2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79222b87-c692-41e8-8151-f5251a3ae466]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa9f366-27f7-43c1-99b4-635e70fa7ab2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:25:46 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b732f765-cbe2-4e6d-92b9-1e6ff03ca93e]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG os_brick.utils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:46 user nova-compute[72863]: INFO nova.compute.manager [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Detaching volume bc54c393-1604-40c7-997e-ff083bdefadf
Aug 15 13:25:46 user nova-compute[72863]: INFO nova.virt.block_device [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Attempting to driver detach volume bc54c393-1604-40c7-997e-ff083bdefadf from mountpoint /dev/vdb
Aug 15 13:25:46 user nova-compute[72863]: INFO nova.compute.manager [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Swapping volume e46f679f-c7c0-418c-b60d-acda73a2d720 for 4a131344-4247-4e54-83e7-6766bd94c850
Aug 15 13:25:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Attempting to detach device vdb from instance e797292e-bcd5-427c-bbfc-c35031f648e5 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:46 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:46 user nova-compute[72863]:   <source dev="/dev/sdl"/>
Aug 15 13:25:46 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:46 user nova-compute[72863]:   <serial>bc54c393-1604-40c7-997e-ff083bdefadf</serial>
Aug 15 13:25:46 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:46 user nova-compute[72863]: </disk>
Aug 15 13:25:46 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:46 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Successfully detached device vdb from instance e797292e-bcd5-427c-bbfc-c35031f648e5 from the persistent domain config.
Aug 15 13:25:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e797292e-bcd5-427c-bbfc-c35031f648e5 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:25:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:25:46 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:25:46 user nova-compute[72863]:   <source dev="/dev/sdl"/>
Aug 15 13:25:46 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:25:46 user nova-compute[72863]:   <serial>bc54c393-1604-40c7-997e-ff083bdefadf</serial>
Aug 15 13:25:46 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:25:46 user nova-compute[72863]: </disk>
Aug 15 13:25:46 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692105947.3750389, e797292e-bcd5-427c-bbfc-c35031f648e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:25:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Successfully detached device vdb from instance e797292e-bcd5-427c-bbfc-c35031f648e5 from the live domain config.
Aug 15 13:25:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roKBHnOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:47 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4608d1c-4be0-43a3-812b-8639413293de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187ba9c-1754-4565-b56a-0b8db0954731]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4d6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf'): ({'sdl'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Removing single pathed devices sdl {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66204d-f4b3-46a2-8fb6-3b9b0ce0c056]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beca970-d91d-4936-9bf6-3779f864530c]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Flushing IO for device /dev/sdl {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1cbff7-29b0-48d2-837b-63db36ee47dd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dbe871-5e8d-4786-887c-c921412d24d9]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] SCSI volumes sdl have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41763c5-586c-4f44-945f-559c5b5535f9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4822b387-5cac-4e05-97bd-cb9f088eb25f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260]
Aug 15 13:25:47 user nova-compute[72863]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:47 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9852907-59fd-4f6d-aa9c-9a67bc9e96e7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] <== disconnect_volume: return (372ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:25:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'flavor' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8602dc85-9707-4603-a1c1-f44729318e2e tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.volume.cinder [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Update attachment failed for attachment 550414a4-62c1-4e12-a609-8651f6d51d64. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Traceback (most recent call last):
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     driver_block_device.attach_block_devices(
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     _log_and_attach(device)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     bdm.attach(*attach_args, **attach_kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     super(DriverVolBlankBlockDevice, self).attach(
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     ret_val = method(obj, context, *args, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     self._do_attach(context, instance, volume, volume_api,
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     self._volume_attach(context, volume, connector, instance,
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     connection_info = volume_api.attachment_update(
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     res = method(self, ctx, *args, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     with excutils.save_and_reraise_exception():
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     self.force_reraise()
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     raise self.value
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     context, '3.44', skip_version_check=True).attachments.update(
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     return method.func(obj, *args, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     resp = self._update('/attachments/%s' % id, body)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     return self._cs_request(url, 'PUT', **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     return self.request(url, method, **kwargs)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db]     raise exceptions.from_response(resp, body)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510)
Aug 15 13:25:48 user nova-compute[72863]: ERROR nova.compute.manager [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] 
Aug 15 13:25:48 user nova-compute[72863]: DEBUG nova.compute.claims [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Aborting claim: <nova.compute.claims.Claim object at 0x7ff5241c8cd0> {{(pid=72863) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 15 13:25:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:25:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.508s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Build of instance 7d63a9af-b303-4b93-ac3e-8bd2ddf582db aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510) {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.utils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Build of instance 7d63a9af-b303-4b93-ac3e-8bd2ddf582db aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed0 {{(pid=72863) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 15 13:25:49 user nova-compute[72863]: ERROR nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Build of instance 7d63a9af-b303-4b93-ac3e-8bd2ddf582db aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510): nova.exception.BuildAbortException: Build of instance 7d63a9af-b303-4b93-ac3e-8bd2ddf582db aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:05ed069d-58c6-4f28-bc67-64d7e56b685b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:bc54c393-1604-40c7-997e-ff083bdefadf was not found.).). (HTTP 500) (Request-ID: req-275f52b4-9992-47f6-a19d-fbfdc9b19510)
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Unplugging VIFs for instance {{(pid=72863) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-730971120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-730971120',id=13,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-m2yn69tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:25:36Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=7d63a9af-b303-4b93-ac3e-8bd2ddf582db,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "address": "fa:16:3e:9b:a5:a9", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7e4c2a-ab", "ovs_interfaceid": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "address": "fa:16:3e:9b:a5:a9", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7e4c2a-ab", "ovs_interfaceid": "bf7e4c2a-abc3-4441-8608-07627ee15e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=bf7e4c2a-abc3-4441-8608-07627ee15e1c,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf7e4c2a-ab') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG os_vif [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=bf7e4c2a-abc3-4441-8608-07627ee15e1c,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf7e4c2a-ab') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf7e4c2a-ab, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:25:49 user nova-compute[72863]: INFO os_vif [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=bf7e4c2a-abc3-4441-8608-07627ee15e1c,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf7e4c2a-ab')
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Unplugged VIFs for instance {{(pid=72863) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:25:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:25:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:50 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:25:51 user nova-compute[72863]: INFO nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Took 1.52 seconds to deallocate network for instance.
Aug 15 13:25:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Detaching volume: 05ed069d-58c6-4f28-bc67-64d7e56b685b {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 15 13:25:51 user nova-compute[72863]: INFO nova.compute.manager [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Detaching volume 05ed069d-58c6-4f28-bc67-64d7e56b685b
Aug 15 13:25:51 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 7d63a9af-b303-4b93-ac3e-8bd2ddf582db] Skipping driver_detach during remote rebuild. {{(pid=72863) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 15 13:25:51 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Deleted allocations for instance 7d63a9af-b303-4b93-ac3e-8bd2ddf582db
Aug 15 13:25:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6a3b85f2-b056-4c63-8727-4cbf0a23b084 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "7d63a9af-b303-4b93-ac3e-8bd2ddf582db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.381s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:25:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '4a131344-4247-4e54-83e7-6766bd94c850', 'serial': '4a131344-4247-4e54-83e7-6766bd94c850'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720'}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720', 'serial'} {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:25:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:25:57 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a919e888-63da-4b4c-aedd-f7b733254bbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:25:57 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc8628-0b5d-4fd7-81ce-950aa6004e9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850] added
Aug 15 13:25:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[942bcaa3-1e1b-4e0c-92b6-d183cd4f9f63]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeeff1f-fca4-4e67-b446-40ef762b65a6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJTVQgOh {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJTVQgOh" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c8398-39ae-43ce-b5a9-71cac70c20bd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJTVQgOh'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[774579e7-0085-474c-96ec-b57c294f5f62]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07371745-369e-4c1e-8354-5f61fd99b587]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141ef95-c802-4263-bd76-e1472362155a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]
Aug 15 13:25:58 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.
Aug 15 13:25:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c088348-c057-4ecc-8d1b-404d3a3a104c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a48ee-bbd4-43dc-abde-83c9632e81f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:25:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] HCTL ('41', '-', '-', 0) found on session 17 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26753cb5-3b82-4619-bbb6-7d2e41da6b01]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:25:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23636336534336362', 'path': '/dev/sdj'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636336534336362', 'path': '/dev/sdj'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lazy-loading 'flavor' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:25:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjYuMNRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'e46f679f-c7c0-418c-b60d-acda73a2d720'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749f68b-022c-48de-8dda-638a93558845]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a1f32-a11c-4abe-b06d-49d83a18324e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720'): ({'sdk'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Removing single pathed devices sdk {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8767bfd-df89-4a26-9c06-a6df73c32d6f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6613155-8982-4b21-a37a-6d74a46aa64d]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Flushing IO for device /dev/sdk {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9dc351-180a-4e13-a86b-eab772cdf605]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[450105fe-f149-4d17-9585-051d5c3aaba7]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] SCSI volumes sdk have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38202a48-b764-4f6b-9543-2ef05038eac9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00b401-8854-4645-bc01-6e674a63988a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260]
Aug 15 13:26:03 user nova-compute[72863]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46f679f-c7c0-418c-b60d-acda73a2d720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e85fb5-d20d-4e5d-9c91-e17bd0da4abe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] <== disconnect_volume: return (359ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '4a131344-4247-4e54-83e7-6766bd94c850', 'serial'} {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 13:26:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: removing Cinder connection for volume e46f679f-c7c0-418c-b60d-acda73a2d720 {{(pid=72863) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 13:26:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] swap_volume: Updating volume e46f679f-c7c0-418c-b60d-acda73a2d720 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "tJTVQgOh", "auth_password": "l5eJstcvVz0gPh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "4a131344-4247-4e54-83e7-6766bd94c850"}, "status": "reserved", "instance": "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d", "attached_at": "", "detached_at": "", "volume_id": "4a131344-4247-4e54-83e7-6766bd94c850", "serial": "4a131344-4247-4e54-83e7-6766bd94c850"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4a131344-4247-4e54-83e7-6766bd94c850', 'no_device': None, 'attachment_id': 'de61ae74-1d9f-4fa0-89ba-75a177087d78'} {{(pid=72863) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 13:26:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fa1bc15-f927-4356-b466-0322985ae583 tempest-TestVolumeSwap-1550267031 tempest-TestVolumeSwap-1550267031-project-admin] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.915s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:05 user nova-compute[72863]: INFO nova.compute.manager [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Detaching volume 4a131344-4247-4e54-83e7-6766bd94c850
Aug 15 13:26:05 user nova-compute[72863]: INFO nova.virt.block_device [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Attempting to driver detach volume 4a131344-4247-4e54-83e7-6766bd94c850 from mountpoint /dev/vdb
Aug 15 13:26:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Attempting to detach device vdb from instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:26:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:26:05 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:26:05 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:26:05 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:26:05 user nova-compute[72863]:   <serial>4a131344-4247-4e54-83e7-6766bd94c850</serial>
Aug 15 13:26:05 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:26:05 user nova-compute[72863]: </disk>
Aug 15 13:26:05 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:26:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Successfully detached device vdb from instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d from the persistent domain config.
Aug 15 13:26:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:26:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:26:05 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:26:05 user nova-compute[72863]:   <source dev="/dev/sdj"/>
Aug 15 13:26:05 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:26:05 user nova-compute[72863]:   <serial>4a131344-4247-4e54-83e7-6766bd94c850</serial>
Aug 15 13:26:05 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:26:05 user nova-compute[72863]: </disk>
Aug 15 13:26:05 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692105966.1870823, 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:26:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Successfully detached device vdb from instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d from the live domain config.
Aug 15 13:26:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJTVQgOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '4a131344-4247-4e54-83e7-6766bd94c850'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:06 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[770124f0-f654-4cb6-a282-b7150fe608d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72330d15-2328-4e2f-a875-c853c453cccf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:06 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850'): ({'sdj'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Removing single pathed devices sdj {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29402946-ad64-4024-b8d1-82cd773a940b]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd1014-ec1c-4104-8ac7-a6392cc26c95]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Flushing IO for device /dev/sdj {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c3883-91b3-4186-8a58-7c729ff41eb1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40901b2e-b918-445d-b806-871ab2094a76]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] SCSI volumes sdj have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7b117-7a28-4dc4-8cc7-854a09ae7065]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc15e4bf-27f3-42e0-bc57-f172c9cdd524]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260]
Aug 15 13:26:06 user nova-compute[72863]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:06 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a131344-4247-4e54-83e7-6766bd94c850 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a71250-7d82-42e2-8a89-0bc2ed74ca30]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] <== disconnect_volume: return (353ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:26:07 user nova-compute[72863]: INFO nova.compute.claims [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Claim successful on node user
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'flavor' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f68c7959-65b5-4e56-83c6-5f09177c5e80 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.921s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:26:07 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:26:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:26:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG nova.policy [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80f4012d293141f89e66f6ea556ca0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7951b03c2da44b6bbb7c5f0746ddd02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:26:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Creating image(s)
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.219s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.220s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk 1073741824" returned: 0 in 0.061s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.223s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:26:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Successfully created port: ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Cannot resize image /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'migration_context' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Ensure instance console log exists: /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Successfully updated port: ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-changed-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing instance network info cache due to event network-changed-ccf2066c-f978-45c7-a691-ee40af7095cb. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Instance network_info: |[{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing network info cache for port ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Start _get_guest_xml network_info=[{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:26:10 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:10 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'pci_devices' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:26:10 user nova-compute[72863]:   <uuid>b3413aa3-879c-46a3-9495-24da1b2e28aa</uuid>
Aug 15 13:26:10 user nova-compute[72863]:   <name>instance-0000000e</name>
Aug 15 13:26:10 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:26:10 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:26:10 user nova-compute[72863]:   <metadata>
Aug 15 13:26:10 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:26:10 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:26:10</nova:creationTime>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:26:10 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:26:10 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:owner>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:26:10 user nova-compute[72863]:       </nova:owner>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:26:10 user nova-compute[72863]:       <nova:ports>
Aug 15 13:26:10 user nova-compute[72863]:         <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:26:10 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:26:10 user nova-compute[72863]:         </nova:port>
Aug 15 13:26:10 user nova-compute[72863]:       </nova:ports>
Aug 15 13:26:10 user nova-compute[72863]:     </nova:instance>
Aug 15 13:26:10 user nova-compute[72863]:   </metadata>
Aug 15 13:26:10 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:26:10 user nova-compute[72863]:     <system>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="serial">b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="uuid">b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:26:10 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:26:10 user nova-compute[72863]:     </system>
Aug 15 13:26:10 user nova-compute[72863]:   </sysinfo>
Aug 15 13:26:10 user nova-compute[72863]:   <os>
Aug 15 13:26:10 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:26:10 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:26:10 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:26:10 user nova-compute[72863]:   </os>
Aug 15 13:26:10 user nova-compute[72863]:   <features>
Aug 15 13:26:10 user nova-compute[72863]:     <acpi/>
Aug 15 13:26:10 user nova-compute[72863]:     <apic/>
Aug 15 13:26:10 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:26:10 user nova-compute[72863]:   </features>
Aug 15 13:26:10 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:26:10 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:26:10 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:26:10 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:26:10 user nova-compute[72863]:   </clock>
Aug 15 13:26:10 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:26:10 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:26:10 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:26:10 user nova-compute[72863]:   </cpu>
Aug 15 13:26:10 user nova-compute[72863]:   <devices>
Aug 15 13:26:10 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:26:10 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:26:10 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk"/>
Aug 15 13:26:10 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:26:10 user nova-compute[72863]:     </disk>
Aug 15 13:26:10 user nova-compute[72863]:     <disk type="file" device="cdrom">
Aug 15 13:26:10 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 13:26:10 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config"/>
Aug 15 13:26:10 user nova-compute[72863]:       <target dev="hda" bus="ide"/>
Aug 15 13:26:10 user nova-compute[72863]:     </disk>
Aug 15 13:26:10 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:26:10 user nova-compute[72863]:       <mac address="fa:16:3e:47:68:49"/>
Aug 15 13:26:10 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:10 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:26:10 user nova-compute[72863]:       <target dev="tapccf2066c-f9"/>
Aug 15 13:26:10 user nova-compute[72863]:     </interface>
Aug 15 13:26:10 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:26:10 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log" append="off"/>
Aug 15 13:26:10 user nova-compute[72863]:     </serial>
Aug 15 13:26:10 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:26:10 user nova-compute[72863]:     <video>
Aug 15 13:26:10 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:10 user nova-compute[72863]:     </video>
Aug 15 13:26:10 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:26:10 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:26:10 user nova-compute[72863]:     </rng>
Aug 15 13:26:10 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:26:10 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:26:10 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:26:10 user nova-compute[72863]:     </memballoon>
Aug 15 13:26:10 user nova-compute[72863]:   </devices>
Aug 15 13:26:10 user nova-compute[72863]: </domain>
Aug 15 13:26:10 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG os_vif [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf2066c-f9, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccf2066c-f9, col_values=(('external_ids', {'iface-id': 'ccf2066c-f978-45c7-a691-ee40af7095cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:68:49', 'vm-uuid': 'b3413aa3-879c-46a3-9495-24da1b2e28aa'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:10 user nova-compute[72863]: INFO os_vif [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9')
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name hda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No VIF found with MAC fa:16:3e:47:68:49, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:26:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Using config drive
Aug 15 13:26:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Creating config drive at /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config
Aug 15 13:26:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvfobrdp7 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvfobrdp7" returned: 0 in 0.056s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updated VIF entry in instance network info cache for port ccf2066c-f978-45c7-a691-ee40af7095cb. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23832512-96c2-4865-ac03-11df3d7adc92 req-1d7c8345-bdae-4e49-a160-3883675ae0c9 service nova] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:12 user nova-compute[72863]: WARNING nova.compute.manager [req-62636c18-19f6-4487-bb47-352ac82a962b req-263f23c5-ed3a-4edd-ab53-1cedd03a724e service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb for instance with vm_state building and task_state spawning.
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:12 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105974.274996, b3413aa3-879c-46a3-9495-24da1b2e28aa => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] VM Resumed (Lifecycle Event)
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Instance spawned successfully.
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105974.2804728, b3413aa3-879c-46a3-9495-24da1b2e28aa => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] VM Started (Lifecycle Event)
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:14 user nova-compute[72863]: INFO nova.compute.manager [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Took 7.19 seconds to build instance.
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:14 user nova-compute[72863]: WARNING nova.compute.manager [req-a1646181-ecb8-4364-bb37-456e1d75e513 req-b38fcdd5-47d7-4949-b868-7e42d261a319 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb for instance with vm_state active and task_state None.
Aug 15 13:26:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a16ae430-5c8c-4d14-8476-e7a0c8f39acb tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:17 user nova-compute[72863]: INFO nova.compute.manager [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Terminating instance
Aug 15 13:26:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-unplugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] No waiting events found dispatching network-vif-unplugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-517aac75-c132-4f89-9590-323905bf9c4e req-6f9e20ff-15f2-4d8e-9c30-ad27828cefd5 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-unplugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Instance destroyed successfully.
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lazy-loading 'resources' on Instance uuid b33fd6c7-9e23-436a-858c-2767f8baf885 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-366986408',display_name='tempest-VolumesAssistedSnapshotsTest-server-366986408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-366986408',id=7,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVoxwJ0XWa9t/xHZAzHaoAeSMFa0rn3Z6ZAnJSzVHth5KST//WBgw8f6ONk/ZRIUOpOk4yxLoFSZ1CI5oSrnoar5btGPzPCmCrl0QBKLkvbAuN14O7xFX3FHM1CgHQuhA==',key_name='tempest-keypair-1476727890',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ae3694f35a64b419c7ada9fc75fea32',ramdisk_id='',reservation_id='r-2jrgvuip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1567405456',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1567405456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f4ef24e638d4b9eaae290fdcf7f33b2',uuid=b33fd6c7-9e23-436a-858c-2767f8baf885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converting VIF {"id": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "address": "fa:16:3e:48:cc:6b", "network": {"id": "3f91845a-abdc-4dc3-bb75-61a804ab3685", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1317596976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ae3694f35a64b419c7ada9fc75fea32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960d42e1-69", "ovs_interfaceid": "960d42e1-6975-4b57-832a-046fd3d3ecb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG os_vif [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap960d42e1-69, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:18 user nova-compute[72863]: INFO os_vif [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:6b,bridge_name='br-int',has_traffic_filtering=True,id=960d42e1-6975-4b57-832a-046fd3d3ecb0,network=Network(3f91845a-abdc-4dc3-bb75-61a804ab3685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960d42e1-69')
Aug 15 13:26:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Deleting instance files /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885_del
Aug 15 13:26:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Deletion of /opt/stack/data/nova/instances/b33fd6c7-9e23-436a-858c-2767f8baf885_del complete
Aug 15 13:26:18 user nova-compute[72863]: INFO nova.compute.manager [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:18 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'b33fd6c7-9e23-436a-858c-2767f8baf885' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b33fd6c7-9e23-436a-858c-2767f8baf885' (instance-00000007)
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:19 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Took 1.33 seconds to deallocate network for instance.
Aug 15 13:26:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-8cf2d249-639e-416e-9c40-051fb3c31668 req-6d19a3df-23ca-4966-8b9b-f8b4c788f0a5 service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-deleted-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] Acquiring lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] No waiting events found dispatching network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:19 user nova-compute[72863]: WARNING nova.compute.manager [req-be320b3b-bceb-46a5-b012-90dcabc7791e req-db7d1090-b032-43c1-a8f1-fd28da9f7acf service nova] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Received unexpected event network-vif-plugged-960d42e1-6975-4b57-832a-046fd3d3ecb0 for instance with vm_state deleted and task_state None.
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:20 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:20 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.83348846435547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.164s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.173s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:20 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Deleted allocations for instance b33fd6c7-9e23-436a-858c-2767f8baf885
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e797292e-bcd5-427c-bbfc-c35031f648e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c50059af-8a64-4b01-98e2-2236cb4f958d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b3413aa3-879c-46a3-9495-24da1b2e28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e59a0b1f-2760-41f6-9264-1cb629278a28 tempest-VolumesAssistedSnapshotsTest-1567405456 tempest-VolumesAssistedSnapshotsTest-1567405456-project-member] Lock "b33fd6c7-9e23-436a-858c-2767f8baf885" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.722s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e4ef0481-3cff-49a0-8c93-eab77a8e923a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.679s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:26:21 user nova-compute[72863]: INFO nova.compute.claims [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Claim successful on node user
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:21 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:26:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:26:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Creating image(s)
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "/opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "/opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.policy [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0de57a132def47359f74cad70c1b2a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c077f561bb445aa9a3a35d2f677f0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.419s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.221s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk 1073741824" returned: 0 in 0.075s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Successfully created port: 65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Cannot resize image /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'migration_context' on Instance uuid e4ef0481-3cff-49a0-8c93-eab77a8e923a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Successfully updated port: 65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquired lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received event network-changed-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Refreshing instance network info cache due to event network-changed-65ac1f7b-de96-45cc-bef8-aae2b963a78f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] Acquiring lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Updating instance_info_cache with network_info: [{"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Releasing lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Instance network_info: |[{"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] Acquired lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Refreshing network info cache for port 65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Start _get_guest_xml network_info=[{"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:26:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-245479421',display_name='tempest-VolumesAdminNegativeTest-server-245479421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-245479421',id=15,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-p1dsjoc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:22Z,user_data=None,user_id='0de57a132def47359f74cad70c1b2a4f',uuid=e4ef0481-3cff-49a0-8c93-eab77a8e923a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ef0481-3cff-49a0-8c93-eab77a8e923a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:26:24 user nova-compute[72863]:   <uuid>e4ef0481-3cff-49a0-8c93-eab77a8e923a</uuid>
Aug 15 13:26:24 user nova-compute[72863]:   <name>instance-0000000f</name>
Aug 15 13:26:24 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:26:24 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:26:24 user nova-compute[72863]:   <metadata>
Aug 15 13:26:24 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:26:24 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:name>tempest-VolumesAdminNegativeTest-server-245479421</nova:name>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:26:24</nova:creationTime>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:26:24 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:26:24 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:owner>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:user uuid="0de57a132def47359f74cad70c1b2a4f">tempest-VolumesAdminNegativeTest-890931694-project-member</nova:user>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:project uuid="5c077f561bb445aa9a3a35d2f677f0d0">tempest-VolumesAdminNegativeTest-890931694</nova:project>
Aug 15 13:26:24 user nova-compute[72863]:       </nova:owner>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:26:24 user nova-compute[72863]:       <nova:ports>
Aug 15 13:26:24 user nova-compute[72863]:         <nova:port uuid="65ac1f7b-de96-45cc-bef8-aae2b963a78f">
Aug 15 13:26:24 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 13:26:24 user nova-compute[72863]:         </nova:port>
Aug 15 13:26:24 user nova-compute[72863]:       </nova:ports>
Aug 15 13:26:24 user nova-compute[72863]:     </nova:instance>
Aug 15 13:26:24 user nova-compute[72863]:   </metadata>
Aug 15 13:26:24 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:26:24 user nova-compute[72863]:     <system>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="serial">e4ef0481-3cff-49a0-8c93-eab77a8e923a</entry>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="uuid">e4ef0481-3cff-49a0-8c93-eab77a8e923a</entry>
Aug 15 13:26:24 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:26:24 user nova-compute[72863]:     </system>
Aug 15 13:26:24 user nova-compute[72863]:   </sysinfo>
Aug 15 13:26:24 user nova-compute[72863]:   <os>
Aug 15 13:26:24 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:26:24 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:26:24 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:26:24 user nova-compute[72863]:   </os>
Aug 15 13:26:24 user nova-compute[72863]:   <features>
Aug 15 13:26:24 user nova-compute[72863]:     <acpi/>
Aug 15 13:26:24 user nova-compute[72863]:     <apic/>
Aug 15 13:26:24 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:26:24 user nova-compute[72863]:   </features>
Aug 15 13:26:24 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:26:24 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:26:24 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:26:24 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:26:24 user nova-compute[72863]:   </clock>
Aug 15 13:26:24 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:26:24 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:26:24 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:26:24 user nova-compute[72863]:   </cpu>
Aug 15 13:26:24 user nova-compute[72863]:   <devices>
Aug 15 13:26:24 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:26:24 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:26:24 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk"/>
Aug 15 13:26:24 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:26:24 user nova-compute[72863]:     </disk>
Aug 15 13:26:24 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:26:24 user nova-compute[72863]:       <mac address="fa:16:3e:d4:d4:47"/>
Aug 15 13:26:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:24 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:26:24 user nova-compute[72863]:       <target dev="tap65ac1f7b-de"/>
Aug 15 13:26:24 user nova-compute[72863]:     </interface>
Aug 15 13:26:24 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:26:24 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/console.log" append="off"/>
Aug 15 13:26:24 user nova-compute[72863]:     </serial>
Aug 15 13:26:24 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:26:24 user nova-compute[72863]:     <video>
Aug 15 13:26:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:24 user nova-compute[72863]:     </video>
Aug 15 13:26:24 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:26:24 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:26:24 user nova-compute[72863]:     </rng>
Aug 15 13:26:24 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:26:24 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:26:24 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:26:24 user nova-compute[72863]:     </memballoon>
Aug 15 13:26:24 user nova-compute[72863]:   </devices>
Aug 15 13:26:24 user nova-compute[72863]: </domain>
Aug 15 13:26:24 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-245479421',display_name='tempest-VolumesAdminNegativeTest-server-245479421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-245479421',id=15,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-p1dsjoc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:22Z,user_data=None,user_id='0de57a132def47359f74cad70c1b2a4f',uuid=e4ef0481-3cff-49a0-8c93-eab77a8e923a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG os_vif [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65ac1f7b-de, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65ac1f7b-de, col_values=(('external_ids', {'iface-id': '65ac1f7b-de96-45cc-bef8-aae2b963a78f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:d4:47', 'vm-uuid': 'e4ef0481-3cff-49a0-8c93-eab77a8e923a'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:24 user nova-compute[72863]: INFO os_vif [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de')
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] No VIF found with MAC fa:16:3e:d4:d4:47, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Updated VIF entry in instance network info cache for port 65ac1f7b-de96-45cc-bef8-aae2b963a78f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Updating instance_info_cache with network_info: [{"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7eee2ece-6c7e-493c-9553-54d74d561c80 req-c4e22be1-2102-491a-a93b-c24ee9f57809 service nova] Releasing lock "refresh_cache-e4ef0481-3cff-49a0-8c93-eab77a8e923a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received event network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] Acquiring lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] No waiting events found dispatching network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:26 user nova-compute[72863]: WARNING nova.compute.manager [req-e3637a22-57fc-4f9b-95c2-12f42c1b2b96 req-d3b383e9-a797-4b36-9f60-ed4578e62e40 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received unexpected event network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f for instance with vm_state building and task_state spawning.
Aug 15 13:26:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:26:27 user nova-compute[72863]: INFO nova.compute.claims [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Claim successful on node user
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:26:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:26:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Creating image(s)
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG nova.policy [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f28612e758464797a56a4b7ea233ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e9e6721b634d2fb974f7a10c6e0359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105988.1809492, e4ef0481-3cff-49a0-8c93-eab77a8e923a => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] VM Resumed (Lifecycle Event)
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk 1073741824" returned: 0 in 0.093s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received event network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] Acquiring lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] No waiting events found dispatching network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:28 user nova-compute[72863]: WARNING nova.compute.manager [req-36bc1773-7bf3-48dd-8920-eb0c4583622a req-62389291-ad49-4fbd-ae6e-7fc1756d2d7c service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received unexpected event network-vif-plugged-65ac1f7b-de96-45cc-bef8-aae2b963a78f for instance with vm_state building and task_state spawning.
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Instance spawned successfully.
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105988.181206, e4ef0481-3cff-49a0-8c93-eab77a8e923a => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] VM Started (Lifecycle Event)
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:28 user nova-compute[72863]: INFO nova.compute.manager [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Took 7.71 seconds to build instance.
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a6c26ef-3d09-4590-ab09-34f9890d238a tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.823s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Cannot resize image /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'migration_context' on Instance uuid cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Ensure instance console log exists: /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Successfully created port: d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Successfully updated port: d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-changed-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Refreshing instance network info cache due to event network-changed-d6d23de8-d0d4-41eb-979d-2492125ccb33. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] Acquiring lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updating instance_info_cache with network_info: [{"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Instance network_info: |[{"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] Acquired lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.neutron [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Refreshing network info cache for port d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Start _get_guest_xml network_info=[{"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:26:31 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:31 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368834085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368834085',id=16,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-w6y5610b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:28Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=cfcc0d13-26ff-4bcd-aac0-d74f9df157c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'pci_devices' on Instance uuid cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:26:31 user nova-compute[72863]:   <uuid>cfcc0d13-26ff-4bcd-aac0-d74f9df157c6</uuid>
Aug 15 13:26:31 user nova-compute[72863]:   <name>instance-00000010</name>
Aug 15 13:26:31 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:26:31 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:26:31 user nova-compute[72863]:   <metadata>
Aug 15 13:26:31 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:26:31 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1368834085</nova:name>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:26:31</nova:creationTime>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:26:31 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:26:31 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:owner>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:user uuid="f28612e758464797a56a4b7ea233ae66">tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member</nova:user>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:project uuid="03e9e6721b634d2fb974f7a10c6e0359">tempest-ServerBootFromVolumeStableRescueTest-603513238</nova:project>
Aug 15 13:26:31 user nova-compute[72863]:       </nova:owner>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:26:31 user nova-compute[72863]:       <nova:ports>
Aug 15 13:26:31 user nova-compute[72863]:         <nova:port uuid="d6d23de8-d0d4-41eb-979d-2492125ccb33">
Aug 15 13:26:31 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 13:26:31 user nova-compute[72863]:         </nova:port>
Aug 15 13:26:31 user nova-compute[72863]:       </nova:ports>
Aug 15 13:26:31 user nova-compute[72863]:     </nova:instance>
Aug 15 13:26:31 user nova-compute[72863]:   </metadata>
Aug 15 13:26:31 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:26:31 user nova-compute[72863]:     <system>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="serial">cfcc0d13-26ff-4bcd-aac0-d74f9df157c6</entry>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="uuid">cfcc0d13-26ff-4bcd-aac0-d74f9df157c6</entry>
Aug 15 13:26:31 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:26:31 user nova-compute[72863]:     </system>
Aug 15 13:26:31 user nova-compute[72863]:   </sysinfo>
Aug 15 13:26:31 user nova-compute[72863]:   <os>
Aug 15 13:26:31 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:26:31 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:26:31 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:26:31 user nova-compute[72863]:   </os>
Aug 15 13:26:31 user nova-compute[72863]:   <features>
Aug 15 13:26:31 user nova-compute[72863]:     <acpi/>
Aug 15 13:26:31 user nova-compute[72863]:     <apic/>
Aug 15 13:26:31 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:26:31 user nova-compute[72863]:   </features>
Aug 15 13:26:31 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:26:31 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:26:31 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:26:31 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:26:31 user nova-compute[72863]:   </clock>
Aug 15 13:26:31 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:26:31 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:26:31 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:26:31 user nova-compute[72863]:   </cpu>
Aug 15 13:26:31 user nova-compute[72863]:   <devices>
Aug 15 13:26:31 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:26:31 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:26:31 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk"/>
Aug 15 13:26:31 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:26:31 user nova-compute[72863]:     </disk>
Aug 15 13:26:31 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:26:31 user nova-compute[72863]:       <mac address="fa:16:3e:70:b6:89"/>
Aug 15 13:26:31 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:31 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:26:31 user nova-compute[72863]:       <target dev="tapd6d23de8-d0"/>
Aug 15 13:26:31 user nova-compute[72863]:     </interface>
Aug 15 13:26:31 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:26:31 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/console.log" append="off"/>
Aug 15 13:26:31 user nova-compute[72863]:     </serial>
Aug 15 13:26:31 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:26:31 user nova-compute[72863]:     <video>
Aug 15 13:26:31 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:31 user nova-compute[72863]:     </video>
Aug 15 13:26:31 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:26:31 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:26:31 user nova-compute[72863]:     </rng>
Aug 15 13:26:31 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:26:31 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:26:31 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:26:31 user nova-compute[72863]:     </memballoon>
Aug 15 13:26:31 user nova-compute[72863]:   </devices>
Aug 15 13:26:31 user nova-compute[72863]: </domain>
Aug 15 13:26:31 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368834085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368834085',id=16,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-w6y5610b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:28Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=cfcc0d13-26ff-4bcd-aac0-d74f9df157c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG os_vif [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6d23de8-d0, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6d23de8-d0, col_values=(('external_ids', {'iface-id': 'd6d23de8-d0d4-41eb-979d-2492125ccb33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:b6:89', 'vm-uuid': 'cfcc0d13-26ff-4bcd-aac0-d74f9df157c6'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:31 user nova-compute[72863]: INFO os_vif [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0')
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No VIF found with MAC fa:16:3e:70:b6:89, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.neutron [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updated VIF entry in instance network info cache for port d6d23de8-d0d4-41eb-979d-2492125ccb33. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG nova.network.neutron [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updating instance_info_cache with network_info: [{"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7b43659-6cf7-46e7-8f60-38a28a61eab6 req-bcbc8b8d-49f3-4e06-92a1-d266fb48a120 service nova] Releasing lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] No waiting events found dispatching network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:33 user nova-compute[72863]: WARNING nova.compute.manager [req-e71d87ac-bbea-4261-af9e-b82b00d498fc req-9173f771-6fb7-4556-ba3b-0401a82b4e1d service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received unexpected event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 for instance with vm_state building and task_state spawning.
Aug 15 13:26:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:33 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692105978.1667109, b33fd6c7-9e23-436a-858c-2767f8baf885 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:33 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] VM Stopped (Lifecycle Event)
Aug 15 13:26:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7e0641bb-dc26-4f79-b46a-3a88473f9107 None None] [instance: b33fd6c7-9e23-436a-858c-2767f8baf885] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] No waiting events found dispatching network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:35 user nova-compute[72863]: WARNING nova.compute.manager [req-066c0724-accb-487b-8b30-748670494d25 req-9e1a02ca-e4c7-4a0e-a3fc-c63e9c083afd service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received unexpected event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 for instance with vm_state building and task_state spawning.
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105995.2345555, cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] VM Resumed (Lifecycle Event)
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Instance spawned successfully.
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692105995.2358196, cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] VM Started (Lifecycle Event)
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Took 7.68 seconds to spawn the instance on the hypervisor.
Aug 15 13:26:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:35 user nova-compute[72863]: INFO nova.compute.manager [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Took 8.52 seconds to build instance.
Aug 15 13:26:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8d4c962b-f4ae-403f-aea4-4a69d1f7473f tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.621s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-changed-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing instance network info cache due to event network-changed-738e2c06-cfbf-4143-aad3-92ae2373b304. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] Acquiring lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] Acquired lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Refreshing network info cache for port 738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updated VIF entry in instance network info cache for port 738e2c06-cfbf-4143-aad3-92ae2373b304. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-243e8ccd-fc47-485a-b0b9-2241e248829e req-66840951-0fb2-4f4b-a307-a57b11ffa456 service nova] Releasing lock "refresh_cache-699ef2fc-40ef-45fc-b89a-5f8ef55e7099" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "772fe730-8857-4520-9006-3972b660b933" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:26:38 user nova-compute[72863]: INFO nova.compute.claims [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Claim successful on node user
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:26:38 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:26:38 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.policy [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd885a5f78b6e4c3c993fee958bee7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8a87964e7845cba898b18f2d5021ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:26:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Creating image(s)
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "/opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.218s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:39 user nova-compute[72863]: INFO nova.compute.manager [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Terminating instance
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk 1073741824" returned: 0 in 0.080s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-4f070886-be67-42ac-8fb1-d1cfbf8d3aed req-1b83dfbd-7c1f-4b12-83d6-fec033fb8b6c service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-738e2c06-cfbf-4143-aad3-92ae2373b304 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Cannot resize image /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'migration_context' on Instance uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Ensure instance console log exists: /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-eb66c2ef-ab00-484f-92d0-e006cf8b89e5 req-f262e4a1-8cce-4b25-bb8c-cfa8a2d07657 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-7f39f606-4844-46af-aa86-90962eed1e3b for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Successfully created port: 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b5900024-1be4-4bbc-ab2d-022becc530e5 req-50147b46-6fa0-4a78-b2dd-cc80a8bd5ca8 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Instance destroyed successfully.
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lazy-loading 'resources' on Instance uuid 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738e2c06-cf, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:00:e4,bridge_name='br-int',has_traffic_filtering=True,id=738e2c06-cfbf-4143-aad3-92ae2373b304,network=Network(7bd43a33-408d-46f9-a9b2-e65d0fb18649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738e2c06-cf')
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f39f606-48, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:41 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:b1,bridge_name='br-int',has_traffic_filtering=True,id=7f39f606-4844-46af-aa86-90962eed1e3b,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f39f606-48')
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbb01944-1f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f6:6e,bridge_name='br-int',has_traffic_filtering=True,id=cbb01944-1f0c-43ff-a5d1-3d2b88619793,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbb01944-1f')
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfff0517f-9f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f0:7b,bridge_name='br-int',has_traffic_filtering=True,id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff0517f-9f')
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf163558b-df, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:22:69,bridge_name='br-int',has_traffic_filtering=True,id=f163558b-dffd-46d6-96e2-6c8c0942f38a,network=Network(6b3979ca-0287-473d-b636-c81fb597df79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf163558b-df')
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d8e1bfa-c8, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:41:28,bridge_name='br-int',has_traffic_filtering=True,id=9d8e1bfa-c8a7-423c-b675-77985bd6a771,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8e1bfa-c8')
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1762836650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1762836650',id=10,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQz3zHQjR6xkmVFmdTd1On8jnH/TQPX1k55KPpRQccchCgPBeaCXFOboFYbI8gE4IX3uSCzoGGufXgD8SOl0Ag5c7tiI8qKhfs38qf13vZW0kIl9VrLGlxmw0+W/EMuw==',key_name='tempest-keypair-1679540394',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfb861158c2c430db44cb7153bb0a7ef',ramdisk_id='',reservation_id='r-xgz52phu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2024362299',owner_user_name='tempest-TaggedBootDevicesTest-2024362299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faaa2918e9a347e687b777c36594e537',uuid=699ef2fc-40ef-45fc-b89a-5f8ef55e7099,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converting VIF {"id": "b55552da-6f98-4a09-b731-777777c7bb74", "address": "fa:16:3e:af:dd:98", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb55552da-6f", "ovs_interfaceid": "b55552da-6f98-4a09-b731-777777c7bb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb55552da-6f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-738e2c06-cfbf-4143-aad3-92ae2373b304 for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-e316ce5d-ad30-4725-9230-e6b402e0c6a6 req-8ac16f2a-5605-4fd5-805a-feacca79e4b7 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:42 user nova-compute[72863]: INFO os_vif [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:dd:98,bridge_name='br-int',has_traffic_filtering=True,id=b55552da-6f98-4a09-b731-777777c7bb74,network=Network(b157ce95-b6d2-47a4-aee8-0427ef1c542b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb55552da-6f')
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsAvkgwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cdf24e-c3d6-4196-a11c-f479ccd163b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32acbc3-f662-4cf0-a812-c453af1c5280]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c54b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3039dc5-a592-4e39-bff1-7211d2e6e79b]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410c8bb-3f68-4a12-9d4a-07b849d517de]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708318c-66ff-4084-8c5b-393e32aaab29]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Successfully updated port: 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e769ddc-08d0-4d56-9f7a-b8d958b06fa7]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccc6c0-735b-41c6-b4a2-2ecf7e5c1af9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-7f39f606-4844-46af-aa86-90962eed1e3b for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-f163558b-dffd-46d6-96e2-6c8c0942f38a for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-f163558b-dffd-46d6-96e2-6c8c0942f38a for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-7bc3d3f7-87ec-4671-b0d8-7d9be7eb5638 req-9258d959-066c-410f-ac24-0e2cb6af3c08 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-9d8e1bfa-c8a7-423c-b675-77985bd6a771 for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b018f9ac-a5a5-42d7-ac74-24a037b6d525]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260]
Aug 15 13:26:42 user nova-compute[72863]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7049283-3fba-4e22-8c15-3780aed84d7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf5ceef-4a71-4205-8245-abd9484e2404]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== disconnect_volume: return (350ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzKpSqMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa79c59-5a8e-460f-b474-f9005644de4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b461ac8-272c-4139-9d7a-4846fd9948eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[794731ac-03a2-4f70-ae8f-40ef44466819]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba7f60-82b9-4175-8d6c-e7652b8f40c3]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1595b78-16f2-44cc-8192-7a950c06258e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0709507b-3451-405b-8bee-5b7fc2f9addb]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-cbb01944-1f0c-43ff-a5d1-3d2b88619793 for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-unplugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-unplugged-b55552da-6f98-4a09-b731-777777c7bb74 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Acquiring lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] No waiting events found dispatching network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:42 user nova-compute[72863]: WARNING nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received unexpected event network-vif-plugged-b55552da-6f98-4a09-b731-777777c7bb74 for instance with vm_state active and task_state deleting.
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing instance network info cache due to event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf89175-ef84-43c0-ac53-170b8f775eb2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Instance network_info: |[{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.network.neutron [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Start _get_guest_xml network_info=[{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb163bc-0e4b-455e-88ba-65ffafa57056]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260]
Aug 15 13:26:42 user nova-compute[72863]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:42 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:43 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1579148946',display_name='tempest-ServerActionsTestOtherA-server-1579148946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1579148946',id=17,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-l8yoj568',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=772fe730-8857-4520-9006-3972b660b933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.objects.instance [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_devices' on Instance uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b3c5df-a7e4-4e94-93e2-d017da42c452 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d4a360-bad4-4637-9bcc-fbeb06875afb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== disconnect_volume: return (419ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:26:43 user nova-compute[72863]:   <uuid>772fe730-8857-4520-9006-3972b660b933</uuid>
Aug 15 13:26:43 user nova-compute[72863]:   <name>instance-00000011</name>
Aug 15 13:26:43 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:26:43 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:26:43 user nova-compute[72863]:   <metadata>
Aug 15 13:26:43 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:26:43 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherA-server-1579148946</nova:name>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:26:43</nova:creationTime>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:26:43 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:26:43 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:owner>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:user uuid="d885a5f78b6e4c3c993fee958bee7cd0">tempest-ServerActionsTestOtherA-278685911-project-member</nova:user>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:project uuid="2d8a87964e7845cba898b18f2d5021ec">tempest-ServerActionsTestOtherA-278685911</nova:project>
Aug 15 13:26:43 user nova-compute[72863]:       </nova:owner>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:26:43 user nova-compute[72863]:       <nova:ports>
Aug 15 13:26:43 user nova-compute[72863]:         <nova:port uuid="3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0">
Aug 15 13:26:43 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 13:26:43 user nova-compute[72863]:         </nova:port>
Aug 15 13:26:43 user nova-compute[72863]:       </nova:ports>
Aug 15 13:26:43 user nova-compute[72863]:     </nova:instance>
Aug 15 13:26:43 user nova-compute[72863]:   </metadata>
Aug 15 13:26:43 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:26:43 user nova-compute[72863]:     <system>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="serial">772fe730-8857-4520-9006-3972b660b933</entry>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="uuid">772fe730-8857-4520-9006-3972b660b933</entry>
Aug 15 13:26:43 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:26:43 user nova-compute[72863]:     </system>
Aug 15 13:26:43 user nova-compute[72863]:   </sysinfo>
Aug 15 13:26:43 user nova-compute[72863]:   <os>
Aug 15 13:26:43 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:26:43 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:26:43 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:26:43 user nova-compute[72863]:   </os>
Aug 15 13:26:43 user nova-compute[72863]:   <features>
Aug 15 13:26:43 user nova-compute[72863]:     <acpi/>
Aug 15 13:26:43 user nova-compute[72863]:     <apic/>
Aug 15 13:26:43 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:26:43 user nova-compute[72863]:   </features>
Aug 15 13:26:43 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:26:43 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:26:43 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:26:43 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:26:43 user nova-compute[72863]:   </clock>
Aug 15 13:26:43 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:26:43 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:26:43 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:26:43 user nova-compute[72863]:   </cpu>
Aug 15 13:26:43 user nova-compute[72863]:   <devices>
Aug 15 13:26:43 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:26:43 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:26:43 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk"/>
Aug 15 13:26:43 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:26:43 user nova-compute[72863]:     </disk>
Aug 15 13:26:43 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:26:43 user nova-compute[72863]:       <mac address="fa:16:3e:98:9d:33"/>
Aug 15 13:26:43 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:43 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:26:43 user nova-compute[72863]:       <target dev="tap3dceaaa1-f0"/>
Aug 15 13:26:43 user nova-compute[72863]:     </interface>
Aug 15 13:26:43 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:26:43 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/console.log" append="off"/>
Aug 15 13:26:43 user nova-compute[72863]:     </serial>
Aug 15 13:26:43 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:26:43 user nova-compute[72863]:     <video>
Aug 15 13:26:43 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:43 user nova-compute[72863]:     </video>
Aug 15 13:26:43 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:26:43 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:26:43 user nova-compute[72863]:     </rng>
Aug 15 13:26:43 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:26:43 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:26:43 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:26:43 user nova-compute[72863]:     </memballoon>
Aug 15 13:26:43 user nova-compute[72863]:   </devices>
Aug 15 13:26:43 user nova-compute[72863]: </domain>
Aug 15 13:26:43 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1579148946',display_name='tempest-ServerActionsTestOtherA-server-1579148946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1579148946',id=17,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-l8yoj568',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=772fe730-8857-4520-9006-3972b660b933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_vif [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCKvInRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dceaaa1-f0, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3dceaaa1-f0, col_values=(('external_ids', {'iface-id': '3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9d:33', 'vm-uuid': '772fe730-8857-4520-9006-3972b660b933'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8c7d7-c978-492a-a19c-c0d7a9bd0f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:43 user nova-compute[72863]: INFO os_vif [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0')
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc88479b-1f89-422c-8a83-32081c783a1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c34e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb3ff89-def8-41f4-b06c-5d1c37c41f86]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:98:9d:33, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[19031f2e-f331-4391-bb32-de4b3d94c128]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4233d258-b108-46ec-8695-fdd202519d14]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee92a07f-c229-4a8f-bd7a-2e9a2a6d9e91]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[baab68dd-559b-4600-85df-712e35066f27]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b749b0dc-9eca-4a2f-abeb-82d266ba2ab4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260]
Aug 15 13:26:43 user nova-compute[72863]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2d22c4-5ff0-4ba1-aa89-783dcac145b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e8927-6923-4cda-a2ee-f2baf21846de]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] <== disconnect_volume: return (348ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Deleting instance files /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099_del
Aug 15 13:26:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Deletion of /opt/stack/data/nova/instances/699ef2fc-40ef-45fc-b89a-5f8ef55e7099_del complete
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.neutron [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated VIF entry in instance network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.neutron [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f6df3406-4a7e-4af7-863c-447e041e5c81 req-7d399323-f5f7-4521-9ad1-07e20ad3ddb5 service nova] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:43 user nova-compute[72863]: INFO nova.compute.manager [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Took 4.21 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:43 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:43 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] Acquiring lock "772fe730-8857-4520-9006-3972b660b933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] No waiting events found dispatching network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:45 user nova-compute[72863]: WARNING nova.compute.manager [req-6f4f309b-e56e-4643-99aa-caaa303b0f3f req-38d1e41d-44c0-4246-95a4-07562d7e97ad service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received unexpected event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 for instance with vm_state building and task_state spawning.
Aug 15 13:26:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-changed-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing instance network info cache due to event network-changed-362939d4-30f2-4f0e-8dda-073fdb3b5979. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] Acquiring lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] Acquired lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG nova.network.neutron [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Refreshing network info cache for port 362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updated VIF entry in instance network info cache for port 362939d4-30f2-4f0e-8dda-073fdb3b5979. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fd97216-9cd8-4edc-baef-5e75aab6084a req-67f4ee94-7e5d-4a29-8c47-b1bea5748fc0 service nova] Releasing lock "refresh_cache-f3de4784-eb7e-4601-a3d4-2f0107849f61" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106007.1873302, 772fe730-8857-4520-9006-3972b660b933 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] VM Resumed (Lifecycle Event)
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 772fe730-8857-4520-9006-3972b660b933] Instance spawned successfully.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Terminating instance
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106007.1897323, 772fe730-8857-4520-9006-3972b660b933 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] VM Started (Lifecycle Event)
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'info_cache' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] Acquiring lock "772fe730-8857-4520-9006-3972b660b933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] No waiting events found dispatching network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:47 user nova-compute[72863]: WARNING nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received unexpected event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 for instance with vm_state building and task_state spawning.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-deleted-b55552da-6f98-4a09-b731-777777c7bb74 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Neutron deleted interface b55552da-6f98-4a09-b731-777777c7bb74; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "address": "fa:16:3e:b6:22:69", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf163558b-df", "ovs_interfaceid": "f163558b-dffd-46d6-96e2-6c8c0942f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Detach interface failed, port_id=b55552da-6f98-4a09-b731-777777c7bb74, reason: Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-deleted-f163558b-dffd-46d6-96e2-6c8c0942f38a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Neutron deleted interface f163558b-dffd-46d6-96e2-6c8c0942f38a; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "address": "fa:16:3e:dd:41:28", "network": {"id": "b157ce95-b6d2-47a4-aee8-0427ef1c542b", "bridge": "br-int", "label": "tempest-device-tagging-net2-408406297", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8e1bfa-c8", "ovs_interfaceid": "9d8e1bfa-c8a7-423c-b675-77985bd6a771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Took 8.33 seconds to spawn the instance on the hypervisor.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9030959-5187-40f9-9ee2-b07f666608b2 req-694b58b4-9434-419d-8c19-826ec73feb44 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Detach interface failed, port_id=f163558b-dffd-46d6-96e2-6c8c0942f38a, reason: Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:47 user nova-compute[72863]: INFO nova.compute.manager [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Took 9.39 seconds to build instance.
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-06efe84d-57cb-4758-ad9d-464454cc7a90 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.564s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-unplugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] No waiting events found dispatching network-vif-unplugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-02d71d3a-3ec4-439f-90ed-b7879a7db4a4 req-ace5cbb1-099b-4fad-818a-32d539cf1a20 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-unplugged-66d323ba-5273-4b45-b683-270ec1ef916b for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Instance destroyed successfully.
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lazy-loading 'resources' on Instance uuid e797292e-bcd5-427c-bbfc-c35031f648e5 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1053167185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1053167',id=9,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQEPGwUkRp7YY3linYig9SIZ1aDdByngSgaGbCG2cXtlGufg1L9C6FeagDwEl0tWhIjwl2JGi5zY+m1mBPKXXEA8NpPjor1znZyeVgxTQeUxebzRBRdl4mnyecQ9pAVZQ==',key_name='tempest-keypair-1628416866',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79baf779b6b8403d98a284fccb6d7ebf',ramdisk_id='',reservation_id='r-xhlpn0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:23:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca72a24784cd40f09c6123c19ab19943',uuid=e797292e-bcd5-427c-bbfc-c35031f648e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converting VIF {"id": "66d323ba-5273-4b45-b683-270ec1ef916b", "address": "fa:16:3e:ab:7b:c5", "network": {"id": "06e9e9fb-91aa-4d03-ae82-e1513b2a61d6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-817225618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79baf779b6b8403d98a284fccb6d7ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66d323ba-52", "ovs_interfaceid": "66d323ba-5273-4b45-b683-270ec1ef916b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_vif [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66d323ba-52, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: INFO os_vif [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:7b:c5,bridge_name='br-int',has_traffic_filtering=True,id=66d323ba-5273-4b45-b683-270ec1ef916b,network=Network(06e9e9fb-91aa-4d03-ae82-e1513b2a61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66d323ba-52')
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Deleting instance files /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5_del
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Deletion of /opt/stack/data/nova/instances/e797292e-bcd5-427c-bbfc-c35031f648e5_del complete
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.compute.manager [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance destroyed successfully.
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'resources' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b260b4c-be, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:48 user nova-compute[72863]: INFO os_vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:48 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:48 user nova-compute[72863]: INFO nova.compute.manager [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Terminating instance
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[41383229-73ec-4c85-a6a1-582d2316bb13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b3ff4-0309-49c7-a269-e5731afc028f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c703370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'): ({'sdh'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Removing single pathed devices sdh {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac8a30-196c-496c-a040-cb0a9d07674f]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e4d56-c7a6-451b-935b-f61aef141697]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flushing IO for device /dev/sdh {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b1f29-7952-4a17-9fba-3f44e9d43cfc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.084s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed771d-e631-48fb-ab3b-e7fa15af6b28]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] SCSI volumes sdh have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5650b46-be06-4362-8212-7b1288796bdc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d2626-e430-4549-bea4-695efe1bbe10]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]
Aug 15 13:26:48 user nova-compute[72863]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8553fa-5078-4a8b-b0cd-c1320d496d86]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.528s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== disconnect_volume: return (530ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start _get_guest_xml network_info=[{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6fbee68d-6844-4320-802b-8537ac9d6e4d', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '86c46771-bc19-4440-9ed1-d713a003b231', 'attached_at': '', 'detached_at': '', 'volume_id': '04eda795-d566-42e7-bbc8-393bd0b46b93', 'serial': '04eda795-d566-42e7-bbc8-393bd0b46b93'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'numa_topology' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:49 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:49 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:49 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae969ec3-a9e1-4bd8-bdce-3d09bb84bf5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:26:49 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc693e6-5434-4ad3-a0fa-7424a4e08bc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93] added
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0625864c-5c11-4e15-9e1b-1414e9dc14c2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb0ce2-e153-4056-91cf-d2b92adc2e04]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XohbjkDt {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XohbjkDt" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b987d7-a84c-4fbf-b96e-b8f99a5aea39]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XohbjkDt'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-52637943-4190-451d-815a-0351e3a303d6 req-ba910ccd-2da3-4197-b343-926a6bcc7302 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-9810641c-fb74-472f-828f-d1f81adb8b49 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14dc518-c7b1-4b58-b79a-9da17ed25a5b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-deleted-9d8e1bfa-c8a7-423c-b675-77985bd6a771 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:49 user nova-compute[72863]: INFO nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Neutron deleted interface 9d8e1bfa-c8a7-423c-b675-77985bd6a771; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "address": "fa:16:3e:21:f0:7b", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff0517f-9f", "ovs_interfaceid": "fff0517f-9ffa-4467-ae63-ebd11a0b8ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0d530-5406-4ee8-b04b-fbab85a59dd7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Detach interface failed, port_id=9d8e1bfa-c8a7-423c-b675-77985bd6a771, reason: Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-deleted-fff0517f-9ffa-4467-ae63-ebd11a0b8ec3 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:49 user nova-compute[72863]: INFO nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Neutron deleted interface fff0517f-9ffa-4467-ae63-ebd11a0b8ec3; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [{"id": "738e2c06-cfbf-4143-aad3-92ae2373b304", "address": "fa:16:3e:09:00:e4", "network": {"id": "7bd43a33-408d-46f9-a9b2-e65d0fb18649", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-847022058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738e2c06-cf", "ovs_interfaceid": "738e2c06-cfbf-4143-aad3-92ae2373b304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f39f606-4844-46af-aa86-90962eed1e3b", "address": "fa:16:3e:90:be:b1", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f39f606-48", "ovs_interfaceid": "7f39f606-4844-46af-aa86-90962eed1e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "address": "fa:16:3e:93:f6:6e", "network": {"id": "6b3979ca-0287-473d-b636-c81fb597df79", "bridge": "br-int", "label": "tempest-device-tagging-net1-1284240241", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dfb861158c2c430db44cb7153bb0a7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb01944-1f", "ovs_interfaceid": "cbb01944-1f0c-43ff-a5d1-3d2b88619793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Detach interface failed, port_id=fff0517f-9ffa-4467-ae63-ebd11a0b8ec3, reason: Instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-789573d4-a4d6-467d-9106-a5cc5013a153 req-edc7dd70-b9b1-4739-b248-62184addd514 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a39fad7-fe20-438c-be7f-4dde6cbd570e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]
Aug 15 13:26:49 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78adf6e-19b0-4208-b618-be0fe50a7c0a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.067s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab3c76-6aa7-484b-b005-f024ad4cfad3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:49 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.580s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.066s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003e2f9-e1d2-4365-a54c-5cba52b13da0]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:26:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Acquiring lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] No waiting events found dispatching network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:50 user nova-compute[72863]: WARNING nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received unexpected event network-vif-plugged-66d323ba-5273-4b45-b683-270ec1ef916b for instance with vm_state active and task_state deleting.
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:50 user nova-compute[72863]: WARNING nova.compute.manager [req-96e0041a-8fab-40a5-b371-1e3aa637ec32 req-fc654bf4-9be5-4793-8d7f-600637506698 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-362939d4-30f2-4f0e-8dda-073fdb3b5979 for instance with vm_state active and task_state deleting.
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:50 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Instance destroyed successfully.
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lazy-loading 'resources' on Instance uuid f3de4784-eb7e-4601-a3d4-2f0107849f61 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap362939d4-30, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Took 6.94 seconds to deallocate network for instance.
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:50 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Took 2.48 seconds to deallocate network for instance.
Aug 15 13:26:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.692s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== connect_volume: return (1693ms) {'type': 'block', 'scsi_wwn': '26639623131643739', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639623131643739', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:50 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9a:04,bridge_name='br-int',has_traffic_filtering=True,id=362939d4-30f2-4f0e-8dda-073fdb3b5979,network=Network(1e57438c-99bd-4dbc-ba90-9a18233ee552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap362939d4-30')
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9810641c-fb, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:26:50 user nova-compute[72863]:   <uuid>86c46771-bc19-4440-9ed1-d713a003b231</uuid>
Aug 15 13:26:50 user nova-compute[72863]:   <name>instance-00000004</name>
Aug 15 13:26:50 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:26:50 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:26:50 user nova-compute[72863]:   <metadata>
Aug 15 13:26:50 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:26:50 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeTestJSON-server-1730461208</nova:name>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:26:49</nova:creationTime>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:26:50 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:26:50 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:owner>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:user uuid="acc0646305654477852de0c8bdebce90">tempest-AttachVolumeTestJSON-1527183200-project-member</nova:user>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:project uuid="974e84d7fd49440bb0449944cc4ffa94">tempest-AttachVolumeTestJSON-1527183200</nova:project>
Aug 15 13:26:50 user nova-compute[72863]:       </nova:owner>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:26:50 user nova-compute[72863]:       <nova:ports>
Aug 15 13:26:50 user nova-compute[72863]:         <nova:port uuid="2b260b4c-bea8-4b7d-9131-0a938ed031e6">
Aug 15 13:26:50 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:26:50 user nova-compute[72863]:         </nova:port>
Aug 15 13:26:50 user nova-compute[72863]:       </nova:ports>
Aug 15 13:26:50 user nova-compute[72863]:     </nova:instance>
Aug 15 13:26:50 user nova-compute[72863]:   </metadata>
Aug 15 13:26:50 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:26:50 user nova-compute[72863]:     <system>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="serial">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="uuid">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:26:50 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:26:50 user nova-compute[72863]:     </system>
Aug 15 13:26:50 user nova-compute[72863]:   </sysinfo>
Aug 15 13:26:50 user nova-compute[72863]:   <os>
Aug 15 13:26:50 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:26:50 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:26:50 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:26:50 user nova-compute[72863]:   </os>
Aug 15 13:26:50 user nova-compute[72863]:   <features>
Aug 15 13:26:50 user nova-compute[72863]:     <acpi/>
Aug 15 13:26:50 user nova-compute[72863]:     <apic/>
Aug 15 13:26:50 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:26:50 user nova-compute[72863]:   </features>
Aug 15 13:26:50 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:26:50 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:26:50 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:26:50 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:26:50 user nova-compute[72863]:   </clock>
Aug 15 13:26:50 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:26:50 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:26:50 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:26:50 user nova-compute[72863]:   </cpu>
Aug 15 13:26:50 user nova-compute[72863]:   <devices>
Aug 15 13:26:50 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:26:50 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:26:50 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk"/>
Aug 15 13:26:50 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:26:50 user nova-compute[72863]:     </disk>
Aug 15 13:26:50 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:26:50 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:26:50 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:26:50 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:26:50 user nova-compute[72863]:       <serial>04eda795-d566-42e7-bbc8-393bd0b46b93</serial>
Aug 15 13:26:50 user nova-compute[72863]:     </disk>
Aug 15 13:26:50 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:26:50 user nova-compute[72863]:       <mac address="fa:16:3e:03:ed:b5"/>
Aug 15 13:26:50 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:50 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:26:50 user nova-compute[72863]:       <target dev="tap2b260b4c-be"/>
Aug 15 13:26:50 user nova-compute[72863]:     </interface>
Aug 15 13:26:50 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:26:50 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/console.log" append="off"/>
Aug 15 13:26:50 user nova-compute[72863]:     </serial>
Aug 15 13:26:50 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:26:50 user nova-compute[72863]:     <video>
Aug 15 13:26:50 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:26:50 user nova-compute[72863]:     </video>
Aug 15 13:26:50 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:26:50 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:26:50 user nova-compute[72863]:     </rng>
Aug 15 13:26:50 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:26:50 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:26:50 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:26:50 user nova-compute[72863]:     </memballoon>
Aug 15 13:26:50 user nova-compute[72863]:   </devices>
Aug 15 13:26:50 user nova-compute[72863]: </domain>
Aug 15 13:26:50 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:57:60,bridge_name='br-int',has_traffic_filtering=True,id=9810641c-fb74-472f-828f-d1f81adb8b49,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9810641c-fb')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b7efb24-cc, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b4:ad,bridge_name='br-int',has_traffic_filtering=True,id=9b7efb24-ccec-4906-aaf1-cc946e10b31a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b7efb24-cc')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd16b09b9-0a, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d16b09b9-0a48-4760-8be3-948cf22cc66a,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16b09b9-0a')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "1f427130-8d12-496d-b601-58d07da6fbad", "address": "fa:16:3e:bb:0e:ce", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f427130-8d", "ovs_interfaceid": "1f427130-8d12-496d-b601-58d07da6fbad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f427130-8d, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0e:ce,bridge_name='br-int',has_traffic_filtering=True,id=1f427130-8d12-496d-b601-58d07da6fbad,network=Network(28f7d679-c9de-4704-b455-128de401d5f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f427130-8d')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape91d807f-c2, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d9:86,bridge_name='br-int',has_traffic_filtering=True,id=e91d807f-c2e4-426a-aee6-d06779ef3c41,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91d807f-c2')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1692401444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1692401444',id=11,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSMyaphHW+v7nnntfAYKmhOdLZeNXY6kPqLd1vvOl5CJyAPyr+Hha0V8PwSUw+lrrViMQ4grXtG2spDTCodAG7slLnieOf0i7vHn8zg71X0gUxCmv2RyMd6i4RTf7U56w==',key_name='tempest-keypair-1105239757',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='affb9a0688ef4d27bed4b287354ef670',ramdisk_id='',reservation_id='r-le2n50a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-777441795',owner_user_name='tempest-TaggedBootDevicesTest_v242-777441795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b5668c5b8b242de9bb4f36bc48b39ad',uuid=f3de4784-eb7e-4601-a3d4-2f0107849f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converting VIF {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb12034d7-dd, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:51 user nova-compute[72863]: INFO os_vif [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:7d:91,bridge_name='br-int',has_traffic_filtering=True,id=b12034d7-ddcc-49d7-afa1-948ef30ee323,network=Network(dfafecc7-b9e8-498b-a719-5e45e5fe605f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb12034d7-dd')
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lNuxdKZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ce38c-5a66-4e86-bff7-cb679fcbc259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae16b19-7b9b-44c8-baa6-70517e7e71cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d'): ({'sde'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Removing single pathed devices sde {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff1ea69-af09-4851-a4e4-27239f8141cf]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2d7338-15b0-4157-ae06-75cdecd61b83]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Flushing IO for device /dev/sde {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a5571-79cd-417e-8e49-a2e45b27ded1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:51 user nova-compute[72863]: WARNING nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9810641c-fb74-472f-828f-d1f81adb8b49 for instance with vm_state active and task_state deleting.
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Received event network-vif-deleted-66d323ba-5273-4b45-b683-270ec1ef916b {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-1f427130-8d12-496d-b601-58d07da6fbad for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:51 user nova-compute[72863]: WARNING nova.compute.manager [req-5a6888d3-f580-42bd-9230-ad2fb6d8867d req-18740e17-2478-44a6-9f72-b7013dd5206a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-1f427130-8d12-496d-b601-58d07da6fbad for instance with vm_state active and task_state deleting.
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bca94c-b1be-4190-90bb-1f2577a18b17]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:51 user nova-compute[72863]: WARNING nova.compute.manager [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-9b7efb24-ccec-4906-aaf1-cc946e10b31a for instance with vm_state active and task_state deleting.
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbd275a9-2ae9-416e-8efd-73af6664fc22 req-313e134c-1281-44a4-b0bf-303a488a1244 service nova] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Received event network-vif-deleted-738e2c06-cfbf-4143-aad3-92ae2373b304 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54554ea2-8176-4b07-92d2-0b2a894f7468]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a751a-9781-496c-a02b-31ac00964dad]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260]
Aug 15 13:26:51 user nova-compute[72863]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.771s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace87f0d-67b7-4f80-a13c-260c4727a27d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce82614-e523-4c48-9ade-95d0c5b02142]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== disconnect_volume: return (462ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.234s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Deleted allocations for instance e797292e-bcd5-427c-bbfc-c35031f648e5
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnVCrKqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a7911-13d4-46c2-b6c5-8dd47dde0259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dced3d3-2a1e-4827-9c43-394c6fc4a92e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff (non-flash)
Aug 15 13:26:51 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff'): ({'sdf'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Removing single pathed devices sdf {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ee537-5377-47cd-9666-206594a2d03a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2fba6c26-416e-4a89-a424-382a592b1ccc tempest-TestServerVolumeAttachScenarioOldVersion-1517725918 tempest-TestServerVolumeAttachScenarioOldVersion-1517725918-project-member] Lock "e797292e-bcd5-427c-bbfc-c35031f648e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.725s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Cannot resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'migration_context' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c28cd5-0424-402e-a0c4-946a8ef23ca8]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Flushing IO for device /dev/sdf {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d0228-c823-409a-b2f6-65a03ae9ff5d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b260b4c-be, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b260b4c-be, col_values=(('external_ids', {'iface-id': '2b260b4c-bea8-4b7d-9131-0a938ed031e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ed:b5', 'vm-uuid': '86c46771-bc19-4440-9ed1-d713a003b231'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:52 user nova-compute[72863]: INFO os_vif [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7598f6f8-66e7-498d-9b7b-d8b723661353]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c24db-a9bf-400a-98bd-85a89f43d420]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-d16b09b9-0a48-4760-8be3-948cf22cc66a for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: WARNING nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-d16b09b9-0a48-4760-8be3-948cf22cc66a for instance with vm_state active and task_state deleting.
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: WARNING nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-e91d807f-c2e4-426a-aee6-d06779ef3c41 for instance with vm_state active and task_state deleting.
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-unplugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-unplugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Acquiring lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] No waiting events found dispatching network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:52 user nova-compute[72863]: WARNING nova.compute.manager [req-398f1690-dfb9-43cd-aa42-b9937e42bf57 req-5b8e3257-5a21-4265-abf2-7357accb4b3e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received unexpected event network-vif-plugged-b12034d7-ddcc-49d7-afa1-948ef30ee323 for instance with vm_state active and task_state deleting.
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.151s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbe8f1-55af-4786-8ac0-184dd4816802]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260]
Aug 15 13:26:52 user nova-compute[72863]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9969ad2-ecb7-4918-bc44-725851c4d3ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a91b9-913b-4f8d-921e-f289c13cbe58]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.576s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== disconnect_volume: return (578ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIWxXBSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:26:52 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5999fea-3d40-4539-9130-5050f9ee661c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a3adc-0d79-4f11-81fd-56988c94322d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 (non-flash)
Aug 15 13:26:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5'): ({'sdg'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Removing single pathed devices sdg {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[057795b1-c87c-49a0-90b4-1bfbbfe97462]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b12cf-9c45-4e1f-932b-cd0d87a83bb6]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Flushing IO for device /dev/sdg {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f7a276-f094-4376-8657-8965cf4f17a8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b1ae2a-d7ab-4809-abd7-b57cd15b6545]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd895217-201b-473d-a7c2-4347183920e6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0168ca79-99b4-46da-8be1-55f6eb47ebac]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260]
Aug 15 13:26:52 user nova-compute[72863]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5, portal: 172.16.0.220,3260] successful.
Aug 15 13:26:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464447d6-45b5-4a5f-b0e8-d9530f015bd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2dd5da-05c7-4d4e-90b1-04b0076d3c71]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] <== disconnect_volume: return (347ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:26:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Deleting instance files /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61_del
Aug 15 13:26:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Deletion of /opt/stack/data/nova/instances/f3de4784-eb7e-4601-a3d4-2f0107849f61_del complete
Aug 15 13:26:52 user nova-compute[72863]: INFO nova.compute.manager [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Took 4.41 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:52 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:52 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:53 user nova-compute[72863]: INFO nova.compute.manager [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Took 3.05 seconds to detach 3 volumes for instance.
Aug 15 13:26:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:54 user nova-compute[72863]: WARNING nova.compute.manager [req-0d02a314-f0f0-4663-a235-3abbb2ad3a38 req-734c64ab-7469-496e-826b-c22ee633fb29 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state powering-on.
Aug 15 13:26:54 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.648s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:54 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Deleted allocations for instance 699ef2fc-40ef-45fc-b89a-5f8ef55e7099
Aug 15 13:26:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e698169e-ae00-4943-be55-65cc3bc0f6d5 tempest-TaggedBootDevicesTest-2024362299 tempest-TaggedBootDevicesTest-2024362299-project-member] Lock "699ef2fc-40ef-45fc-b89a-5f8ef55e7099" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.235s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2b4898c-9f65-406b-a5ae-325c5c30fa4e req-58bcd971-fe10-43d2-9380-fbbd43cad11e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-deleted-1f427130-8d12-496d-b601-58d07da6fbad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:55 user nova-compute[72863]: INFO nova.compute.manager [req-f2b4898c-9f65-406b-a5ae-325c5c30fa4e req-58bcd971-fe10-43d2-9380-fbbd43cad11e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Neutron deleted interface 1f427130-8d12-496d-b601-58d07da6fbad; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-f2b4898c-9f65-406b-a5ae-325c5c30fa4e req-58bcd971-fe10-43d2-9380-fbbd43cad11e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "address": "fa:16:3e:8c:b2:4e", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16b09b9-0a", "ovs_interfaceid": "d16b09b9-0a48-4760-8be3-948cf22cc66a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2b4898c-9f65-406b-a5ae-325c5c30fa4e req-58bcd971-fe10-43d2-9380-fbbd43cad11e service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Detach interface failed, port_id=1f427130-8d12-496d-b601-58d07da6fbad, reason: Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-changed-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Refreshing instance network info cache due to event network-changed-d35084d7-08f9-40d2-9f40-24a4abd65953. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] Acquiring lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] Acquired lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Refreshing network info cache for port d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:55 user nova-compute[72863]: INFO nova.compute.manager [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Terminating instance
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updated VIF entry in instance network info cache for port d35084d7-08f9-40d2-9f40-24a4abd65953. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updating instance_info_cache with network_info: [{"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac8da7ea-5625-4884-b168-2ccb575234ed req-1780b1e0-1dd5-434a-8bfc-04510c69bce1 service nova] Releasing lock "refresh_cache-c50059af-8a64-4b01-98e2-2236cb4f958d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Terminating instance
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106016.493956, 86c46771-bc19-4440-9ed1-d713a003b231 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Resumed (Lifecycle Event)
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance rebooted successfully.
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ece4393b-73b5-48d5-a247-4c2efa102308 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:56 user nova-compute[72863]: WARNING nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state powering-on.
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-unplugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] No waiting events found dispatching network-vif-unplugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c1968fc-85cb-46f6-987d-ef0f98dd5d40 req-4da6a7a4-23a7-4f5e-a9e5-834938e1bb16 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-unplugged-d35084d7-08f9-40d2-9f40-24a4abd65953 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106016.5022173, 86c46771-bc19-4440-9ed1-d713a003b231 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Started (Lifecycle Event)
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106001.7579873, 699ef2fc-40ef-45fc-b89a-5f8ef55e7099 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:26:56 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] VM Stopped (Lifecycle Event)
Aug 15 13:26:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-dbb57ebe-eb30-4793-befa-1bc104644e2a None None] [instance: 699ef2fc-40ef-45fc-b89a-5f8ef55e7099] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Instance destroyed successfully.
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'resources' on Instance uuid c50059af-8a64-4b01-98e2-2236cb4f958d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1617760626',display_name='tempest-AttachVolumeNegativeTest-server-1617760626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1617760626',id=12,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYrxUZzX5tPGtlbkx36jppfZ0ZbFFH4PxoPvrizr37H3m/sJHno+4RwEX8zp8e4KuUNMnjEQE4ov8j8Ovw0Iwgxya6tUg9DCQ0lNTznJmgtJGywf6hsAzis5ZXH19R/uw==',key_name='tempest-keypair-934298311',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:25:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-pc4z13ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=c50059af-8a64-4b01-98e2-2236cb4f958d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "d35084d7-08f9-40d2-9f40-24a4abd65953", "address": "fa:16:3e:b2:ab:a8", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35084d7-08", "ovs_interfaceid": "d35084d7-08f9-40d2-9f40-24a4abd65953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG os_vif [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd35084d7-08, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Instance destroyed successfully.
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lazy-loading 'resources' on Instance uuid 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1600720426',display_name='tempest-TestVolumeSwap-server-1600720426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1600720426',id=8,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLN/u0hXwzPltgYk4Sze7AlhsCeolND2KznNFTWm7jmRmKWWkucSusLQZan7uElyDm30mH4XnsYcBm/7wLwI+yWhuUmUQKMHbNxpKOZgiW8gF4VhGQId3BFXBm6nwDKf2A==',key_name='tempest-keypair-329291675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61f4a984fb814da6aad384e7595851ea',ramdisk_id='',reservation_id='r-htdnbxqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1715847175',owner_user_name='tempest-TestVolumeSwap-1715847175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8782f0b0aad4918835dd1795f50aa6c',uuid=72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converting VIF {"id": "054d7665-62e7-4bac-9741-1917b3e1c35d", "address": "fa:16:3e:85:74:4d", "network": {"id": "16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1134917369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61f4a984fb814da6aad384e7595851ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054d7665-62", "ovs_interfaceid": "054d7665-62e7-4bac-9741-1917b3e1c35d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG os_vif [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:26:57 user nova-compute[72863]: INFO os_vif [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=d35084d7-08f9-40d2-9f40-24a4abd65953,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35084d7-08')
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Deleting instance files /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d_del
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Deletion of /opt/stack/data/nova/instances/c50059af-8a64-4b01-98e2-2236cb4f958d_del complete
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap054d7665-62, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:57 user nova-compute[72863]: INFO os_vif [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:74:4d,bridge_name='br-int',has_traffic_filtering=True,id=054d7665-62e7-4bac-9741-1917b3e1c35d,network=Network(16d6409c-b1c0-4eb5-8556-7fdf6ce8dcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054d7665-62')
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Deleting instance files /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d_del
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Deletion of /opt/stack/data/nova/instances/72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d_del complete
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.compute.manager [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Took 1.53 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.compute.manager [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-deleted-d16b09b9-0a48-4760-8be3-948cf22cc66a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Neutron deleted interface d16b09b9-0a48-4760-8be3-948cf22cc66a; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "address": "fa:16:3e:91:d9:86", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91d807f-c2", "ovs_interfaceid": "e91d807f-c2e4-426a-aee6-d06779ef3c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Detach interface failed, port_id=d16b09b9-0a48-4760-8be3-948cf22cc66a, reason: Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-deleted-e91d807f-c2e4-426a-aee6-d06779ef3c41 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:57 user nova-compute[72863]: INFO nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Neutron deleted interface e91d807f-c2e4-426a-aee6-d06779ef3c41; detaching it from the instance and deleting it from the info cache
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [{"id": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "address": "fa:16:3e:11:9a:04", "network": {"id": "1e57438c-99bd-4dbc-ba90-9a18233ee552", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-53448929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap362939d4-30", "ovs_interfaceid": "362939d4-30f2-4f0e-8dda-073fdb3b5979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9810641c-fb74-472f-828f-d1f81adb8b49", "address": "fa:16:3e:04:57:60", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9810641c-fb", "ovs_interfaceid": "9810641c-fb74-472f-828f-d1f81adb8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "address": "fa:16:3e:60:b4:ad", "network": {"id": "28f7d679-c9de-4704-b455-128de401d5f9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1606844884", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7efb24-cc", "ovs_interfaceid": "9b7efb24-ccec-4906-aaf1-cc946e10b31a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "address": "fa:16:3e:4e:7d:91", "network": {"id": "dfafecc7-b9e8-498b-a719-5e45e5fe605f", "bridge": "br-int", "label": "tempest-device-tagging-net2-891778795", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "affb9a0688ef4d27bed4b287354ef670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb12034d7-dd", "ovs_interfaceid": "b12034d7-ddcc-49d7-afa1-948ef30ee323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-unplugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] No waiting events found dispatching network-vif-unplugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-unplugged-054d7665-62e7-4bac-9741-1917b3e1c35d for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] No waiting events found dispatching network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:57 user nova-compute[72863]: WARNING nova.compute.manager [req-935c86b8-02bd-4969-b984-4463f8084a14 req-e2c2f7fd-427c-4b90-b1cd-460671c8847f service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received unexpected event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d for instance with vm_state active and task_state deleting.
Aug 15 13:26:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-6539454a-f80e-4e3d-9e53-5f2315748565 req-869af299-0c30-4f3b-b809-49856e6df992 service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Detach interface failed, port_id=e91d807f-c2e4-426a-aee6-d06779ef3c41, reason: Instance f3de4784-eb7e-4601-a3d4-2f0107849f61 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:26:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:58 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Took 5.52 seconds to deallocate network for instance.
Aug 15 13:26:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] Acquiring lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] No waiting events found dispatching network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:58 user nova-compute[72863]: WARNING nova.compute.manager [req-5a7d3df0-da56-440b-b575-90a9a8c1d185 req-4103070d-852e-4b4c-befe-d1161a28d4db service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received unexpected event network-vif-plugged-d35084d7-08f9-40d2-9f40-24a4abd65953 for instance with vm_state active and task_state deleting.
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:59 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Took 1.82 seconds to deallocate network for instance.
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:26:59 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Took 1.95 seconds to deallocate network for instance.
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-5c0e727d-4cb0-4433-9e56-d901c5179806 req-d83bf136-ba85-42c1-9a8d-b5ca56dbc40a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-deleted-362939d4-30f2-4f0e-8dda-073fdb3b5979 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-5c0e727d-4cb0-4433-9e56-d901c5179806 req-d83bf136-ba85-42c1-9a8d-b5ca56dbc40a service nova] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Received event network-vif-deleted-b12034d7-ddcc-49d7-afa1-948ef30ee323 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] Acquiring lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] No waiting events found dispatching network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:26:59 user nova-compute[72863]: WARNING nova.compute.manager [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received unexpected event network-vif-plugged-054d7665-62e7-4bac-9741-1917b3e1c35d for instance with vm_state deleted and task_state None.
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-c818a970-b87d-455a-82eb-8fb0c9af90de req-41d5cc8c-1cbe-4407-a6be-868d33fb3e21 service nova] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Received event network-vif-deleted-d35084d7-08f9-40d2-9f40-24a4abd65953 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.505s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:26:59 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Deleted allocations for instance 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d
Aug 15 13:26:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a7511ec4-d778-425a-af39-a55583294a81 tempest-TestVolumeSwap-1715847175 tempest-TestVolumeSwap-1715847175-project-member] Lock "72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.911s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:00 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:27:00 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:27:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:00 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Deleted allocations for instance c50059af-8a64-4b01-98e2-2236cb4f958d
Aug 15 13:27:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f06cfeb0-b2e2-4a12-91e6-0e2d25c869e5 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "c50059af-8a64-4b01-98e2-2236cb4f958d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.759s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-6984f9ec-beb7-4188-b6a3-ced9d365614a req-8c1b7a67-48cf-4cb4-aa24-bd2e0b45e253 service nova] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Received event network-vif-deleted-054d7665-62e7-4bac-9741-1917b3e1c35d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:27:01 user nova-compute[72863]: INFO nova.compute.manager [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Took 3.03 seconds to detach 3 volumes for instance.
Aug 15 13:27:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:01 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:27:01 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:27:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:02 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Deleted allocations for instance f3de4784-eb7e-4601-a3d4-2f0107849f61
Aug 15 13:27:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9ac550ba-8d8a-43f4-8abe-ecc6f95d1da7 tempest-TaggedBootDevicesTest_v242-777441795 tempest-TaggedBootDevicesTest_v242-777441795-project-member] Lock "f3de4784-eb7e-4601-a3d4-2f0107849f61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.623s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:03 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106008.2196882, e797292e-bcd5-427c-bbfc-c35031f648e5 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:03 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] VM Stopped (Lifecycle Event)
Aug 15 13:27:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d59d8937-0ea7-420c-b121-d4b1ae262dbf None None] [instance: e797292e-bcd5-427c-bbfc-c35031f648e5] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:05 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106010.698865, f3de4784-eb7e-4601-a3d4-2f0107849f61 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:05 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] VM Stopped (Lifecycle Event)
Aug 15 13:27:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-da56e0fb-539f-40f9-9b82-f3b37205d4b5 None None] [instance: f3de4784-eb7e-4601-a3d4-2f0107849f61] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:11 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106016.983631, c50059af-8a64-4b01-98e2-2236cb4f958d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:11 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] VM Stopped (Lifecycle Event)
Aug 15 13:27:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e23d48bc-c4d0-4ee6-bd74-11a3d3fec273 None None] [instance: c50059af-8a64-4b01-98e2-2236cb4f958d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:12 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106017.0440307, 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:12 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] VM Stopped (Lifecycle Event)
Aug 15 13:27:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-dee670b9-e726-4505-88f4-6eb09aa9b9fc None None] [instance: 72787cd0-e8e7-4fe2-8ff7-9ab80fa58f8d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:27:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:27:19 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7234MB free_disk=25.808990478515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b3413aa3-879c-46a3-9495-24da1b2e28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e4ef0481-3cff-49a0-8c93-eab77a8e923a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:27:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:27:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:27:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:27:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:27:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:27:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating instance_info_cache with network_info: [{"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-fcac4ae5-a862-496e-b30f-b4c73bcc3368" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:27:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:27:24 user nova-compute[72863]: INFO nova.compute.claims [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Claim successful on node user
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:27:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.policy [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '826608d086c948d499935fa979257ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916d31a5dc5443e9bbe7045f316d0b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:27:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Creating image(s)
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "/opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "/opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk 1073741824" returned: 0 in 0.044s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Successfully created port: 4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:27:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Cannot resize image /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'migration_context' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Ensure instance console log exists: /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Successfully updated port: 4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquired lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-changed-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Refreshing instance network info cache due to event network-changed-4ead8ee0-af24-4eaa-a260-05aa1970388e. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] Acquiring lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:27:26 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updating instance_info_cache with network_info: [{"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Releasing lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Instance network_info: |[{"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] Acquired lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.neutron [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Refreshing network info cache for port 4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Start _get_guest_xml network_info=[{"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:27:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:27:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1385141772',display_name='tempest-VolumesSnapshotTestJSON-instance-1385141772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1385141772',id=18,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPUiCuMAUh6sgpwcN51e1nGLu/6VDZcEKShGIBpvPBqZQFESnoX8mj2ylP7Cfac3e1UfYhotEiPeOuefZbPyPER/Ur4se0Lj3vBMPssYNT3k+PZ4NtVVhs05wvt5DHGvA==',key_name='tempest-keypair-1698194092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-0781rc1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:27:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=0ca9115a-03b2-48f5-b908-6d4f4247e7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:27:27 user nova-compute[72863]:   <uuid>0ca9115a-03b2-48f5-b908-6d4f4247e7fe</uuid>
Aug 15 13:27:27 user nova-compute[72863]:   <name>instance-00000012</name>
Aug 15 13:27:27 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:27:27 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:27:27 user nova-compute[72863]:   <metadata>
Aug 15 13:27:27 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:27:27 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1385141772</nova:name>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:27:27</nova:creationTime>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:27:27 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:27:27 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:owner>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:user uuid="826608d086c948d499935fa979257ffa">tempest-VolumesSnapshotTestJSON-1485635322-project-member</nova:user>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:project uuid="916d31a5dc5443e9bbe7045f316d0b7f">tempest-VolumesSnapshotTestJSON-1485635322</nova:project>
Aug 15 13:27:27 user nova-compute[72863]:       </nova:owner>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:27:27 user nova-compute[72863]:       <nova:ports>
Aug 15 13:27:27 user nova-compute[72863]:         <nova:port uuid="4ead8ee0-af24-4eaa-a260-05aa1970388e">
Aug 15 13:27:27 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 13:27:27 user nova-compute[72863]:         </nova:port>
Aug 15 13:27:27 user nova-compute[72863]:       </nova:ports>
Aug 15 13:27:27 user nova-compute[72863]:     </nova:instance>
Aug 15 13:27:27 user nova-compute[72863]:   </metadata>
Aug 15 13:27:27 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:27:27 user nova-compute[72863]:     <system>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="serial">0ca9115a-03b2-48f5-b908-6d4f4247e7fe</entry>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="uuid">0ca9115a-03b2-48f5-b908-6d4f4247e7fe</entry>
Aug 15 13:27:27 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:27:27 user nova-compute[72863]:     </system>
Aug 15 13:27:27 user nova-compute[72863]:   </sysinfo>
Aug 15 13:27:27 user nova-compute[72863]:   <os>
Aug 15 13:27:27 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:27:27 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:27:27 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:27:27 user nova-compute[72863]:   </os>
Aug 15 13:27:27 user nova-compute[72863]:   <features>
Aug 15 13:27:27 user nova-compute[72863]:     <acpi/>
Aug 15 13:27:27 user nova-compute[72863]:     <apic/>
Aug 15 13:27:27 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:27:27 user nova-compute[72863]:   </features>
Aug 15 13:27:27 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:27:27 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:27:27 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:27:27 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:27:27 user nova-compute[72863]:   </clock>
Aug 15 13:27:27 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:27:27 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:27:27 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:27:27 user nova-compute[72863]:   </cpu>
Aug 15 13:27:27 user nova-compute[72863]:   <devices>
Aug 15 13:27:27 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:27:27 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:27:27 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk"/>
Aug 15 13:27:27 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:27:27 user nova-compute[72863]:     </disk>
Aug 15 13:27:27 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:27:27 user nova-compute[72863]:       <mac address="fa:16:3e:5e:da:49"/>
Aug 15 13:27:27 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:27:27 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:27:27 user nova-compute[72863]:       <target dev="tap4ead8ee0-af"/>
Aug 15 13:27:27 user nova-compute[72863]:     </interface>
Aug 15 13:27:27 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:27:27 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/console.log" append="off"/>
Aug 15 13:27:27 user nova-compute[72863]:     </serial>
Aug 15 13:27:27 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:27:27 user nova-compute[72863]:     <video>
Aug 15 13:27:27 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:27:27 user nova-compute[72863]:     </video>
Aug 15 13:27:27 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:27:27 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:27:27 user nova-compute[72863]:     </rng>
Aug 15 13:27:27 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:27:27 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:27:27 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:27:27 user nova-compute[72863]:     </memballoon>
Aug 15 13:27:27 user nova-compute[72863]:   </devices>
Aug 15 13:27:27 user nova-compute[72863]: </domain>
Aug 15 13:27:27 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1385141772',display_name='tempest-VolumesSnapshotTestJSON-instance-1385141772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1385141772',id=18,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPUiCuMAUh6sgpwcN51e1nGLu/6VDZcEKShGIBpvPBqZQFESnoX8mj2ylP7Cfac3e1UfYhotEiPeOuefZbPyPER/Ur4se0Lj3vBMPssYNT3k+PZ4NtVVhs05wvt5DHGvA==',key_name='tempest-keypair-1698194092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-0781rc1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:27:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=0ca9115a-03b2-48f5-b908-6d4f4247e7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG os_vif [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ead8ee0-af, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ead8ee0-af, col_values=(('external_ids', {'iface-id': '4ead8ee0-af24-4eaa-a260-05aa1970388e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:da:49', 'vm-uuid': '0ca9115a-03b2-48f5-b908-6d4f4247e7fe'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:27 user nova-compute[72863]: INFO os_vif [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af')
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No VIF found with MAC fa:16:3e:5e:da:49, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.neutron [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updated VIF entry in instance network info cache for port 4ead8ee0-af24-4eaa-a260-05aa1970388e. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG nova.network.neutron [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updating instance_info_cache with network_info: [{"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:27:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8bd0110d-b364-4420-afc8-8ef23fb736b1 req-fa84a037-b4cb-4a36-b598-ef01bc26ddcf service nova] Releasing lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] No waiting events found dispatching network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:27:28 user nova-compute[72863]: WARNING nova.compute.manager [req-f413f14b-b3d8-4e97-9871-3732f7888a58 req-bf5537db-90fb-4165-bc2a-015b5ec1f921 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received unexpected event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e for instance with vm_state building and task_state spawning.
Aug 15 13:27:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106050.6783392, 0ca9115a-03b2-48f5-b908-6d4f4247e7fe => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] VM Resumed (Lifecycle Event)
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Instance spawned successfully.
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106050.6795485, 0ca9115a-03b2-48f5-b908-6d4f4247e7fe => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] VM Started (Lifecycle Event)
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] No waiting events found dispatching network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:27:30 user nova-compute[72863]: WARNING nova.compute.manager [req-d0d9d5b5-fb64-4235-84b2-bfc0cf08543d req-140fd9e9-05ff-43e0-bfd0-1f72f2a395d6 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received unexpected event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e for instance with vm_state building and task_state spawning.
Aug 15 13:27:30 user nova-compute[72863]: INFO nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 15 13:27:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:27:31 user nova-compute[72863]: INFO nova.compute.manager [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Took 6.28 seconds to build instance.
Aug 15 13:27:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3fa9e9bc-c0ee-416d-ac66-2e666575798f tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:48 user nova-compute[72863]: INFO nova.compute.manager [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Detaching volume fc33af2d-4882-4984-afe0-65728dc7d395
Aug 15 13:27:48 user nova-compute[72863]: INFO nova.virt.block_device [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Attempting to driver detach volume fc33af2d-4882-4984-afe0-65728dc7d395 from mountpoint /dev/vdb
Aug 15 13:27:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Attempting to detach device vdb from instance 8518b46b-8053-41e4-9c1f-9b4215965ddc from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:27:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:27:48 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:27:48 user nova-compute[72863]:   <source dev="/dev/sdi"/>
Aug 15 13:27:48 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:27:48 user nova-compute[72863]:   <serial>fc33af2d-4882-4984-afe0-65728dc7d395</serial>
Aug 15 13:27:48 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:27:48 user nova-compute[72863]: </disk>
Aug 15 13:27:48 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:27:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance 8518b46b-8053-41e4-9c1f-9b4215965ddc from the persistent domain config.
Aug 15 13:27:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8518b46b-8053-41e4-9c1f-9b4215965ddc from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:27:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:27:48 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:27:48 user nova-compute[72863]:   <source dev="/dev/sdi"/>
Aug 15 13:27:48 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:27:48 user nova-compute[72863]:   <serial>fc33af2d-4882-4984-afe0-65728dc7d395</serial>
Aug 15 13:27:48 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:27:48 user nova-compute[72863]: </disk>
Aug 15 13:27:48 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106069.0165038, 8518b46b-8053-41e4-9c1f-9b4215965ddc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:27:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance 8518b46b-8053-41e4-9c1f-9b4215965ddc from the live domain config.
Aug 15 13:27:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdMvtgUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:27:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d0a9c-8e5c-4d8a-ae91-a9f9dc28ac49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[314bc08d-092c-4b81-a0fa-b8bbd5f816be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:27:49 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:27:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 (non-flash)
Aug 15 13:27:49 user nova-compute[72863]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:27:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395'): ({'sdi'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Removing single pathed devices sdi {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b347423-0167-459c-a189-5da1a95e3117]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e97edf-9d11-4192-819d-a6431177bd0c]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flushing IO for device /dev/sdi {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16350c-faf2-4a8c-b495-78e71330bcae]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef3155-d928-4b31-ad47-93b53588de2d]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] SCSI volumes sdi have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7a8e55-5daf-45b2-8110-3ae3f195c67c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdb2fa4-d704-429e-afc6-48c5d49ac449]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260]
Aug 15 13:27:49 user nova-compute[72863]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395, portal: 172.16.0.220,3260] successful.
Aug 15 13:27:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33af2d-4882-4984-afe0-65728dc7d395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c350a-6bec-482b-99d9-dab030b36944]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== disconnect_volume: return (323ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:27:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:27:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1128a0c8-7f7b-42e0-a1d3-bd75f7256653 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.798s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-changed-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing instance network info cache due to event network-changed-ccf2066c-f978-45c7-a691-ee40af7095cb. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG nova.network.neutron [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing network info cache for port ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:27:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updated VIF entry in instance network info cache for port ccf2066c-f978-45c7-a691-ee40af7095cb. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-099eaf6c-331c-437f-9da8-34dc7a97a5f5 req-c5d49d8f-526f-4d66-a842-5fe45f9c9659 service nova] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'pci_requests' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:28:00 user nova-compute[72863]: DEBUG nova.policy [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80f4012d293141f89e66f6ea556ca0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7951b03c2da44b6bbb7c5f0746ddd02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Successfully created port: 80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Successfully updated port: 80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-changed-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing instance network info cache due to event network-changed-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Refreshing network info cache for port 80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG os_vif [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b425ec-96, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80b425ec-96, col_values=(('external_ids', {'iface-id': '80b425ec-96e9-4c79-b7f6-b5d6cf6d4629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f5:5d', 'vm-uuid': 'b3413aa3-879c-46a3-9495-24da1b2e28aa'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: INFO os_vif [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96')
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] attach device xml: <interface type="ethernet">
Aug 15 13:28:02 user nova-compute[72863]:   <mac address="fa:16:3e:2d:f5:5d"/>
Aug 15 13:28:02 user nova-compute[72863]:   <model type="virtio"/>
Aug 15 13:28:02 user nova-compute[72863]:   <mtu size="1442"/>
Aug 15 13:28:02 user nova-compute[72863]:   <target dev="tap80b425ec-96"/>
Aug 15 13:28:02 user nova-compute[72863]: </interface>
Aug 15 13:28:02 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:03 user nova-compute[72863]: WARNING nova.compute.manager [req-1b2a1e19-c155-4954-aba2-1bd40711345f req-17beb787-f431-4ba3-9291-e273156eafb0 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 for instance with vm_state active and task_state None.
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name hda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No VIF found with MAC fa:16:3e:47:68:49, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updated VIF entry in instance network info cache for port 80b425ec-96e9-4c79-b7f6-b5d6cf6d4629. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dc68cc20-fa13-49ad-b057-a846752e28d3 req-d76081f4-5503-4d68-b3b4-d8268358bc33 service nova] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:03 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:03</nova:creationTime>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:03 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:03 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:03 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:03 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:03 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:03 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:03 user nova-compute[72863]:     <nova:port uuid="80b425ec-96e9-4c79-b7f6-b5d6cf6d4629">
Aug 15 13:28:03 user nova-compute[72863]:       <nova:ip type="fixed" address="10.10.10.231" ipVersion="4"/>
Aug 15 13:28:03 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:03 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:03 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:03 user nova-compute[72863]:  {{(pid=72863) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6fba9ce8-d719-4557-9194-67f58bd6fd1a tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.478s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:04 user nova-compute[72863]: INFO nova.compute.manager [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Attaching volume f1b29994-e842-4909-b08d-65ad9a594a4c to /dev/vdb
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.utils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc903d17-a91a-4102-b520-71bcbc546abe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f7311-05cb-4745-9445-624afcb29edf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ddb5b-7a17-406d-974f-747219a7cf5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b546a9e-d4d8-4c5f-b1cb-3a1964992b9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:28:04 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:28:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad83d0b-b567-4d32-b34d-7c132ed70b6c]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG os_brick.utils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating existing volume attachment record: f69fdfd3-165a-468c-99f5-71c9292cc786 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:28:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:05 user nova-compute[72863]: WARNING nova.compute.manager [req-08712f88-4bbf-408d-b8c5-43a19badc93c req-1cdbf782-aad8-4ede-bb64-2731e09001c6 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 for instance with vm_state active and task_state None.
Aug 15 13:28:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLNIgAwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:28:15 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:28:15 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:28:15 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757c390-2b4a-4f5b-8380-08d5a098219d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:28:15 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec5386-3ad1-484d-abc9-30fbf64c2387]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c] added
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73f4c81-d695-4a42-800c-64e4a1d9642a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9fd16e-dbf6-4a4c-8eb0-0e39773e713c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLNIgAwR {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLNIgAwR" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561c516-6465-4efd-a551-94cee5840a63]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLNIgAwR'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e373b-e9b1-4c63-aa18-7145e40da26c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796c3df-3b0d-4693-a653-f05e108a70d6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77acb26-1122-4a8e-a0f3-64eceb91bd86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260]
Aug 15 13:28:15 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260] successful.
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2568c7-09c8-4d90-a35c-b8ead51b5442]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2933790-f68b-4194-a530-0036246f7ac4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:15 user nova-compute[72863]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:15 user nova-compute[72863]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)
Aug 15 13:28:15 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08132827-55e8-4316-95e6-c4d00004a8ef]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:28:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLNIgAwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23338626161313237', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338626161313237', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:28:16 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:28:16 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:28:16 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:28:16 user nova-compute[72863]:   <serial>f1b29994-e842-4909-b08d-65ad9a594a4c</serial>
Aug 15 13:28:16 user nova-compute[72863]: </disk>
Aug 15 13:28:16 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No BDM found with device name hda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] No VIF found with MAC fa:16:3e:47:68:49, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1e5f0878-b380-478b-ad06-ed02e96b723c tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.323s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:18 user nova-compute[72863]: INFO nova.compute.manager [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] instance snapshotting
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Beginning live snapshot process
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.240s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f.delta 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f.delta 1073741824" returned: 0 in 0.057s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 13:28:19 user nova-compute[72863]: INFO nova.compute.manager [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Detaching volume f1b29994-e842-4909-b08d-65ad9a594a4c
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: INFO nova.virt.block_device [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Attempting to driver detach volume f1b29994-e842-4909-b08d-65ad9a594a4c from mountpoint /dev/vdb
Aug 15 13:28:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Attempting to detach device vdb from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:28:19 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:28:19 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:28:19 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:28:19 user nova-compute[72863]:   <serial>f1b29994-e842-4909-b08d-65ad9a594a4c</serial>
Aug 15 13:28:19 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:28:19 user nova-compute[72863]: </disk>
Aug 15 13:28:19 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully detached device vdb from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the persistent domain config.
Aug 15 13:28:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:28:19 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:28:19 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:28:19 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:28:19 user nova-compute[72863]:   <serial>f1b29994-e842-4909-b08d-65ad9a594a4c</serial>
Aug 15 13:28:19 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:28:19 user nova-compute[72863]: </disk>
Aug 15 13:28:19 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] COPY block job progress, current cursor: 2686976 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106100.4503806, b3413aa3-879c-46a3-9495-24da1b2e28aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:28:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully detached device vdb from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the live domain config.
Aug 15 13:28:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLNIgAwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:28:20 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f17e65-e7a3-4a82-ab5e-6b7ff7f786c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f05a7f-5d9c-49fc-8a49-3b7e8b5b4bf8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:20 user nova-compute[72863]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)
Aug 15 13:28:20 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:20 user nova-compute[72863]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c (non-flash)
Aug 15 13:28:20 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4d6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a41b37-3509-455e-98ae-2e33cf6e8c0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[908606ee-60fa-4bf6-9721-1850284de195]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:28:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7321MB free_disk=25.765117645263672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de511c9-4f59-4a22-8479-031d0c7de91e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23609f98-fe97-41f8-bf8c-3399f28330ca]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d977ee-82db-4c7f-851d-6e6e1a7281de]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f.delta /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1365a629-00c4-4120-8d10-722c4ac2d52d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260]
Aug 15 13:28:21 user nova-compute[72863]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c, portal: 172.16.0.220,3260] successful.
Aug 15 13:28:21 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 8518b46b-8053-41e4-9c1f-9b4215965ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance b3413aa3-879c-46a3-9495-24da1b2e28aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e4ef0481-3cff-49a0-8c93-eab77a8e923a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b29994-e842-4909-b08d-65ad9a594a4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1fab8-ee91-4b42-b84f-f0deab5b9848]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.954s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] <== disconnect_volume: return (957ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f.delta /opt/stack/data/nova/instances/snapshots/tmpmr3qfq5e/59e0a1eb9c404b17a1a971510677e19f" returned: 0 in 0.439s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Snapshot extracted, beginning image upload
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:28:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c6011df-c481-4c06-8182-b7c04a5ae719 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.202s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Attempting to detach device tap80b425ec-96 from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] detach device xml: <interface type="ethernet">
Aug 15 13:28:22 user nova-compute[72863]:   <mac address="fa:16:3e:2d:f5:5d"/>
Aug 15 13:28:22 user nova-compute[72863]:   <model type="virtio"/>
Aug 15 13:28:22 user nova-compute[72863]:   <mtu size="1442"/>
Aug 15 13:28:22 user nova-compute[72863]:   <target dev="tap80b425ec-96"/>
Aug 15 13:28:22 user nova-compute[72863]: </interface>
Aug 15 13:28:22 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 15 13:28:22 user nova-compute[72863]:   <name>instance-0000000e</name>
Aug 15 13:28:22 user nova-compute[72863]:   <uuid>b3413aa3-879c-46a3-9495-24da1b2e28aa</uuid>
Aug 15 13:28:22 user nova-compute[72863]:   <metadata>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:22 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:03</nova:creationTime>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:22 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:22 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:22 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:22 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:22 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:22 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:22 user nova-compute[72863]:     <nova:port uuid="80b425ec-96e9-4c79-b7f6-b5d6cf6d4629">
Aug 15 13:28:22 user nova-compute[72863]:       <nova:ip type="fixed" address="10.10.10.231" ipVersion="4"/>
Aug 15 13:28:22 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:22 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:22 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:22 user nova-compute[72863]:   </metadata>
Aug 15 13:28:22 user nova-compute[72863]:   <memory unit='KiB'>524288</memory>
Aug 15 13:28:22 user nova-compute[72863]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 13:28:22 user nova-compute[72863]:   <vcpu placement='static'>1</vcpu>
Aug 15 13:28:22 user nova-compute[72863]:   <resource>
Aug 15 13:28:22 user nova-compute[72863]:     <partition>/machine</partition>
Aug 15 13:28:22 user nova-compute[72863]:   </resource>
Aug 15 13:28:22 user nova-compute[72863]:   <sysinfo type='smbios'>
Aug 15 13:28:22 user nova-compute[72863]:     <system>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='version'>0.0.0</entry>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='serial'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='uuid'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:22 user nova-compute[72863]:       <entry name='family'>Virtual Machine</entry>
Aug 15 13:28:22 user nova-compute[72863]:     </system>
Aug 15 13:28:22 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:22 user nova-compute[72863]:   <os>
Aug 15 13:28:22 user nova-compute[72863]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 13:28:22 user nova-compute[72863]:     <boot dev='hd'/>
Aug 15 13:28:22 user nova-compute[72863]:     <smbios mode='sysinfo'/>
Aug 15 13:28:22 user nova-compute[72863]:   </os>
Aug 15 13:28:22 user nova-compute[72863]:   <features>
Aug 15 13:28:22 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:22 user nova-compute[72863]:     <apic/>
Aug 15 13:28:22 user nova-compute[72863]:     <vmcoreinfo state='on'/>
Aug 15 13:28:22 user nova-compute[72863]:   </features>
Aug 15 13:28:22 user nova-compute[72863]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 13:28:22 user nova-compute[72863]:     <model fallback='forbid'>Nehalem</model>
Aug 15 13:28:22 user nova-compute[72863]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 13:28:22 user nova-compute[72863]:     <feature policy='require' name='vme'/>
Aug 15 13:28:22 user nova-compute[72863]:     <feature policy='require' name='x2apic'/>
Aug 15 13:28:22 user nova-compute[72863]:     <feature policy='require' name='hypervisor'/>
Aug 15 13:28:22 user nova-compute[72863]:   </cpu>
Aug 15 13:28:22 user nova-compute[72863]:   <clock offset='utc'>
Aug 15 13:28:22 user nova-compute[72863]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 13:28:22 user nova-compute[72863]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 13:28:22 user nova-compute[72863]:     <timer name='hpet' present='no'/>
Aug 15 13:28:22 user nova-compute[72863]:   </clock>
Aug 15 13:28:22 user nova-compute[72863]:   <on_poweroff>destroy</on_poweroff>
Aug 15 13:28:22 user nova-compute[72863]:   <on_reboot>restart</on_reboot>
Aug 15 13:28:22 user nova-compute[72863]:   <on_crash>destroy</on_crash>
Aug 15 13:28:22 user nova-compute[72863]:   <devices>
Aug 15 13:28:22 user nova-compute[72863]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 13:28:22 user nova-compute[72863]:     <disk type='file' device='disk'>
Aug 15 13:28:22 user nova-compute[72863]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 13:28:22 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk' index='2'/>
Aug 15 13:28:22 user nova-compute[72863]:       <backingStore type='file' index='3'>
Aug 15 13:28:22 user nova-compute[72863]:         <format type='raw'/>
Aug 15 13:28:22 user nova-compute[72863]:         <source file='/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14'/>
Aug 15 13:28:22 user nova-compute[72863]:         <backingStore/>
Aug 15 13:28:22 user nova-compute[72863]:       </backingStore>
Aug 15 13:28:22 user nova-compute[72863]:       <target dev='vda' bus='virtio'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='virtio-disk0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </disk>
Aug 15 13:28:22 user nova-compute[72863]:     <disk type='file' device='cdrom'>
Aug 15 13:28:22 user nova-compute[72863]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 13:28:22 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config' index='1'/>
Aug 15 13:28:22 user nova-compute[72863]:       <backingStore/>
Aug 15 13:28:22 user nova-compute[72863]:       <target dev='hda' bus='ide'/>
Aug 15 13:28:22 user nova-compute[72863]:       <readonly/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='ide0-0-0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </disk>
Aug 15 13:28:22 user nova-compute[72863]:     <controller type='usb' index='0' model='none'>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='usb'/>
Aug 15 13:28:22 user nova-compute[72863]:     </controller>
Aug 15 13:28:22 user nova-compute[72863]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='pci.0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </controller>
Aug 15 13:28:22 user nova-compute[72863]:     <controller type='ide' index='0'>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='ide'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 13:28:22 user nova-compute[72863]:     </controller>
Aug 15 13:28:22 user nova-compute[72863]:     <interface type='ethernet'>
Aug 15 13:28:22 user nova-compute[72863]:       <mac address='fa:16:3e:47:68:49'/>
Aug 15 13:28:22 user nova-compute[72863]:       <target dev='tapccf2066c-f9'/>
Aug 15 13:28:22 user nova-compute[72863]:       <model type='virtio'/>
Aug 15 13:28:22 user nova-compute[72863]:       <mtu size='1442'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='net0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </interface>
Aug 15 13:28:22 user nova-compute[72863]:     <interface type='ethernet'>
Aug 15 13:28:22 user nova-compute[72863]:       <mac address='fa:16:3e:2d:f5:5d'/>
Aug 15 13:28:22 user nova-compute[72863]:       <target dev='tap80b425ec-96'/>
Aug 15 13:28:22 user nova-compute[72863]:       <model type='virtio'/>
Aug 15 13:28:22 user nova-compute[72863]:       <mtu size='1442'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='net1'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </interface>
Aug 15 13:28:22 user nova-compute[72863]:     <serial type='pty'>
Aug 15 13:28:22 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:22 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:22 user nova-compute[72863]:       <target type='isa-serial' port='0'>
Aug 15 13:28:22 user nova-compute[72863]:         <model name='isa-serial'/>
Aug 15 13:28:22 user nova-compute[72863]:       </target>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </serial>
Aug 15 13:28:22 user nova-compute[72863]:     <console type='pty' tty='/dev/pts/4'>
Aug 15 13:28:22 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:22 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:22 user nova-compute[72863]:       <target type='serial' port='0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </console>
Aug 15 13:28:22 user nova-compute[72863]:     <input type='mouse' bus='ps2'>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='input0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </input>
Aug 15 13:28:22 user nova-compute[72863]:     <input type='keyboard' bus='ps2'>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='input1'/>
Aug 15 13:28:22 user nova-compute[72863]:     </input>
Aug 15 13:28:22 user nova-compute[72863]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 15 13:28:22 user nova-compute[72863]:       <listen type='address' address='0.0.0.0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </graphics>
Aug 15 13:28:22 user nova-compute[72863]:     <audio id='1' type='none'/>
Aug 15 13:28:22 user nova-compute[72863]:     <video>
Aug 15 13:28:22 user nova-compute[72863]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='video0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </video>
Aug 15 13:28:22 user nova-compute[72863]:     <memballoon model='virtio'>
Aug 15 13:28:22 user nova-compute[72863]:       <stats period='10'/>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='balloon0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:22 user nova-compute[72863]:     <rng model='virtio'>
Aug 15 13:28:22 user nova-compute[72863]:       <backend model='random'>/dev/urandom</backend>
Aug 15 13:28:22 user nova-compute[72863]:       <alias name='rng0'/>
Aug 15 13:28:22 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 13:28:22 user nova-compute[72863]:     </rng>
Aug 15 13:28:22 user nova-compute[72863]:   </devices>
Aug 15 13:28:22 user nova-compute[72863]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 13:28:22 user nova-compute[72863]:     <label>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</label>
Aug 15 13:28:22 user nova-compute[72863]:     <imagelabel>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</imagelabel>
Aug 15 13:28:22 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:22 user nova-compute[72863]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 13:28:22 user nova-compute[72863]:     <label>+64055:+108</label>
Aug 15 13:28:22 user nova-compute[72863]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 13:28:22 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:22 user nova-compute[72863]: </domain>
Aug 15 13:28:22 user nova-compute[72863]:  {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 13:28:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully detached device tap80b425ec-96 from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the persistent domain config.
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] (1/8): Attempting to detach device tap80b425ec-96 with device alias net1 from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:28:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] detach device xml: <interface type="ethernet">
Aug 15 13:28:22 user nova-compute[72863]:   <mac address="fa:16:3e:2d:f5:5d"/>
Aug 15 13:28:22 user nova-compute[72863]:   <model type="virtio"/>
Aug 15 13:28:22 user nova-compute[72863]:   <mtu size="1442"/>
Aug 15 13:28:22 user nova-compute[72863]:   <target dev="tap80b425ec-96"/>
Aug 15 13:28:22 user nova-compute[72863]: </interface>
Aug 15 13:28:22 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106103.07665, b3413aa3-879c-46a3-9495-24da1b2e28aa => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Start waiting for the detach event from libvirt for device tap80b425ec-96 with device alias net1 for instance b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 15 13:28:23 user nova-compute[72863]:   <name>instance-0000000e</name>
Aug 15 13:28:23 user nova-compute[72863]:   <uuid>b3413aa3-879c-46a3-9495-24da1b2e28aa</uuid>
Aug 15 13:28:23 user nova-compute[72863]:   <metadata>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:23 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:03</nova:creationTime>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:23 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:23 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:23 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:port uuid="80b425ec-96e9-4c79-b7f6-b5d6cf6d4629">
Aug 15 13:28:23 user nova-compute[72863]:       <nova:ip type="fixed" address="10.10.10.231" ipVersion="4"/>
Aug 15 13:28:23 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:23 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:23 user nova-compute[72863]:   </metadata>
Aug 15 13:28:23 user nova-compute[72863]:   <memory unit='KiB'>524288</memory>
Aug 15 13:28:23 user nova-compute[72863]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 13:28:23 user nova-compute[72863]:   <vcpu placement='static'>1</vcpu>
Aug 15 13:28:23 user nova-compute[72863]:   <resource>
Aug 15 13:28:23 user nova-compute[72863]:     <partition>/machine</partition>
Aug 15 13:28:23 user nova-compute[72863]:   </resource>
Aug 15 13:28:23 user nova-compute[72863]:   <sysinfo type='smbios'>
Aug 15 13:28:23 user nova-compute[72863]:     <system>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='version'>0.0.0</entry>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='serial'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='uuid'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:23 user nova-compute[72863]:       <entry name='family'>Virtual Machine</entry>
Aug 15 13:28:23 user nova-compute[72863]:     </system>
Aug 15 13:28:23 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:23 user nova-compute[72863]:   <os>
Aug 15 13:28:23 user nova-compute[72863]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 13:28:23 user nova-compute[72863]:     <boot dev='hd'/>
Aug 15 13:28:23 user nova-compute[72863]:     <smbios mode='sysinfo'/>
Aug 15 13:28:23 user nova-compute[72863]:   </os>
Aug 15 13:28:23 user nova-compute[72863]:   <features>
Aug 15 13:28:23 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:23 user nova-compute[72863]:     <apic/>
Aug 15 13:28:23 user nova-compute[72863]:     <vmcoreinfo state='on'/>
Aug 15 13:28:23 user nova-compute[72863]:   </features>
Aug 15 13:28:23 user nova-compute[72863]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 13:28:23 user nova-compute[72863]:     <model fallback='forbid'>Nehalem</model>
Aug 15 13:28:23 user nova-compute[72863]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 13:28:23 user nova-compute[72863]:     <feature policy='require' name='vme'/>
Aug 15 13:28:23 user nova-compute[72863]:     <feature policy='require' name='x2apic'/>
Aug 15 13:28:23 user nova-compute[72863]:     <feature policy='require' name='hypervisor'/>
Aug 15 13:28:23 user nova-compute[72863]:   </cpu>
Aug 15 13:28:23 user nova-compute[72863]:   <clock offset='utc'>
Aug 15 13:28:23 user nova-compute[72863]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 13:28:23 user nova-compute[72863]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 13:28:23 user nova-compute[72863]:     <timer name='hpet' present='no'/>
Aug 15 13:28:23 user nova-compute[72863]:   </clock>
Aug 15 13:28:23 user nova-compute[72863]:   <on_poweroff>destroy</on_poweroff>
Aug 15 13:28:23 user nova-compute[72863]:   <on_reboot>restart</on_reboot>
Aug 15 13:28:23 user nova-compute[72863]:   <on_crash>destroy</on_crash>
Aug 15 13:28:23 user nova-compute[72863]:   <devices>
Aug 15 13:28:23 user nova-compute[72863]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 13:28:23 user nova-compute[72863]:     <disk type='file' device='disk'>
Aug 15 13:28:23 user nova-compute[72863]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 13:28:23 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk' index='2'/>
Aug 15 13:28:23 user nova-compute[72863]:       <backingStore type='file' index='3'>
Aug 15 13:28:23 user nova-compute[72863]:         <format type='raw'/>
Aug 15 13:28:23 user nova-compute[72863]:         <source file='/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14'/>
Aug 15 13:28:23 user nova-compute[72863]:         <backingStore/>
Aug 15 13:28:23 user nova-compute[72863]:       </backingStore>
Aug 15 13:28:23 user nova-compute[72863]:       <target dev='vda' bus='virtio'/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='virtio-disk0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </disk>
Aug 15 13:28:23 user nova-compute[72863]:     <disk type='file' device='cdrom'>
Aug 15 13:28:23 user nova-compute[72863]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 13:28:23 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config' index='1'/>
Aug 15 13:28:23 user nova-compute[72863]:       <backingStore/>
Aug 15 13:28:23 user nova-compute[72863]:       <target dev='hda' bus='ide'/>
Aug 15 13:28:23 user nova-compute[72863]:       <readonly/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='ide0-0-0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </disk>
Aug 15 13:28:23 user nova-compute[72863]:     <controller type='usb' index='0' model='none'>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='usb'/>
Aug 15 13:28:23 user nova-compute[72863]:     </controller>
Aug 15 13:28:23 user nova-compute[72863]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='pci.0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </controller>
Aug 15 13:28:23 user nova-compute[72863]:     <controller type='ide' index='0'>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='ide'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 13:28:23 user nova-compute[72863]:     </controller>
Aug 15 13:28:23 user nova-compute[72863]:     <interface type='ethernet'>
Aug 15 13:28:23 user nova-compute[72863]:       <mac address='fa:16:3e:47:68:49'/>
Aug 15 13:28:23 user nova-compute[72863]:       <target dev='tapccf2066c-f9'/>
Aug 15 13:28:23 user nova-compute[72863]:       <model type='virtio'/>
Aug 15 13:28:23 user nova-compute[72863]:       <mtu size='1442'/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='net0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </interface>
Aug 15 13:28:23 user nova-compute[72863]:     <serial type='pty'>
Aug 15 13:28:23 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:23 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:23 user nova-compute[72863]:       <target type='isa-serial' port='0'>
Aug 15 13:28:23 user nova-compute[72863]:         <model name='isa-serial'/>
Aug 15 13:28:23 user nova-compute[72863]:       </target>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </serial>
Aug 15 13:28:23 user nova-compute[72863]:     <console type='pty' tty='/dev/pts/4'>
Aug 15 13:28:23 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:23 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:23 user nova-compute[72863]:       <target type='serial' port='0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </console>
Aug 15 13:28:23 user nova-compute[72863]:     <input type='mouse' bus='ps2'>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='input0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </input>
Aug 15 13:28:23 user nova-compute[72863]:     <input type='keyboard' bus='ps2'>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='input1'/>
Aug 15 13:28:23 user nova-compute[72863]:     </input>
Aug 15 13:28:23 user nova-compute[72863]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 15 13:28:23 user nova-compute[72863]:       <listen type='address' address='0.0.0.0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </graphics>
Aug 15 13:28:23 user nova-compute[72863]:     <audio id='1' type='none'/>
Aug 15 13:28:23 user nova-compute[72863]:     <video>
Aug 15 13:28:23 user nova-compute[72863]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='video0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </video>
Aug 15 13:28:23 user nova-compute[72863]:     <memballoon model='virtio'>
Aug 15 13:28:23 user nova-compute[72863]:       <stats period='10'/>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='balloon0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:23 user nova-compute[72863]:     <rng model='virtio'>
Aug 15 13:28:23 user nova-compute[72863]:       <backend model='random'>/dev/urandom</backend>
Aug 15 13:28:23 user nova-compute[72863]:       <alias name='rng0'/>
Aug 15 13:28:23 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 13:28:23 user nova-compute[72863]:     </rng>
Aug 15 13:28:23 user nova-compute[72863]:   </devices>
Aug 15 13:28:23 user nova-compute[72863]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 13:28:23 user nova-compute[72863]:     <label>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</label>
Aug 15 13:28:23 user nova-compute[72863]:     <imagelabel>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</imagelabel>
Aug 15 13:28:23 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:23 user nova-compute[72863]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 13:28:23 user nova-compute[72863]:     <label>+64055:+108</label>
Aug 15 13:28:23 user nova-compute[72863]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 13:28:23 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:23 user nova-compute[72863]: </domain>
Aug 15 13:28:23 user nova-compute[72863]:  {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 13:28:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully detached device tap80b425ec-96 from instance b3413aa3-879c-46a3-9495-24da1b2e28aa from the live domain config.
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG os_vif [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b425ec-96, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:23 user nova-compute[72863]: INFO os_vif [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96')
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:23 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:23</nova:creationTime>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:23 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:23 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:23 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:23 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:23 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:23 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:23 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:23 user nova-compute[72863]:  {{(pid=72863) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-unplugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-unplugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:23 user nova-compute[72863]: WARNING nova.compute.manager [req-f41f371e-de35-4661-93ab-b4d05f0c41c9 req-869e5188-ace3-4ea7-aba6-fef657d14350 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-unplugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 for instance with vm_state active and task_state None.
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-deleted-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:24 user nova-compute[72863]: INFO nova.compute.manager [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Neutron deleted interface 80b425ec-96e9-4c79-b7f6-b5d6cf6d4629; detaching it from the instance and deleting it from the info cache
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquired lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.objects.instance [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Lazy-loading 'system_metadata' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.objects.instance [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Lazy-loading 'flavor' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 15 13:28:24 user nova-compute[72863]:   <name>instance-0000000e</name>
Aug 15 13:28:24 user nova-compute[72863]:   <uuid>b3413aa3-879c-46a3-9495-24da1b2e28aa</uuid>
Aug 15 13:28:24 user nova-compute[72863]:   <metadata>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:24 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:23</nova:creationTime>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:24 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:24 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:24 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:24 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:24 user nova-compute[72863]:   </metadata>
Aug 15 13:28:24 user nova-compute[72863]:   <memory unit='KiB'>524288</memory>
Aug 15 13:28:24 user nova-compute[72863]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 13:28:24 user nova-compute[72863]:   <vcpu placement='static'>1</vcpu>
Aug 15 13:28:24 user nova-compute[72863]:   <resource>
Aug 15 13:28:24 user nova-compute[72863]:     <partition>/machine</partition>
Aug 15 13:28:24 user nova-compute[72863]:   </resource>
Aug 15 13:28:24 user nova-compute[72863]:   <sysinfo type='smbios'>
Aug 15 13:28:24 user nova-compute[72863]:     <system>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='version'>0.0.0</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='serial'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='uuid'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='family'>Virtual Machine</entry>
Aug 15 13:28:24 user nova-compute[72863]:     </system>
Aug 15 13:28:24 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:24 user nova-compute[72863]:   <os>
Aug 15 13:28:24 user nova-compute[72863]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 13:28:24 user nova-compute[72863]:     <boot dev='hd'/>
Aug 15 13:28:24 user nova-compute[72863]:     <smbios mode='sysinfo'/>
Aug 15 13:28:24 user nova-compute[72863]:   </os>
Aug 15 13:28:24 user nova-compute[72863]:   <features>
Aug 15 13:28:24 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:24 user nova-compute[72863]:     <apic/>
Aug 15 13:28:24 user nova-compute[72863]:     <vmcoreinfo state='on'/>
Aug 15 13:28:24 user nova-compute[72863]:   </features>
Aug 15 13:28:24 user nova-compute[72863]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 13:28:24 user nova-compute[72863]:     <model fallback='forbid'>Nehalem</model>
Aug 15 13:28:24 user nova-compute[72863]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='vme'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='x2apic'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='hypervisor'/>
Aug 15 13:28:24 user nova-compute[72863]:   </cpu>
Aug 15 13:28:24 user nova-compute[72863]:   <clock offset='utc'>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='hpet' present='no'/>
Aug 15 13:28:24 user nova-compute[72863]:   </clock>
Aug 15 13:28:24 user nova-compute[72863]:   <on_poweroff>destroy</on_poweroff>
Aug 15 13:28:24 user nova-compute[72863]:   <on_reboot>restart</on_reboot>
Aug 15 13:28:24 user nova-compute[72863]:   <on_crash>destroy</on_crash>
Aug 15 13:28:24 user nova-compute[72863]:   <devices>
Aug 15 13:28:24 user nova-compute[72863]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 13:28:24 user nova-compute[72863]:     <disk type='file' device='disk'>
Aug 15 13:28:24 user nova-compute[72863]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 13:28:24 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk' index='2'/>
Aug 15 13:28:24 user nova-compute[72863]:       <backingStore type='file' index='3'>
Aug 15 13:28:24 user nova-compute[72863]:         <format type='raw'/>
Aug 15 13:28:24 user nova-compute[72863]:         <source file='/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14'/>
Aug 15 13:28:24 user nova-compute[72863]:         <backingStore/>
Aug 15 13:28:24 user nova-compute[72863]:       </backingStore>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='vda' bus='virtio'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='virtio-disk0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </disk>
Aug 15 13:28:24 user nova-compute[72863]:     <disk type='file' device='cdrom'>
Aug 15 13:28:24 user nova-compute[72863]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 13:28:24 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config' index='1'/>
Aug 15 13:28:24 user nova-compute[72863]:       <backingStore/>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='hda' bus='ide'/>
Aug 15 13:28:24 user nova-compute[72863]:       <readonly/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='ide0-0-0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </disk>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='usb' index='0' model='none'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='usb'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='pci.0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='ide' index='0'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='ide'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <interface type='ethernet'>
Aug 15 13:28:24 user nova-compute[72863]:       <mac address='fa:16:3e:47:68:49'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='tapccf2066c-f9'/>
Aug 15 13:28:24 user nova-compute[72863]:       <model type='virtio'/>
Aug 15 13:28:24 user nova-compute[72863]:       <mtu size='1442'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='net0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </interface>
Aug 15 13:28:24 user nova-compute[72863]:     <serial type='pty'>
Aug 15 13:28:24 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:24 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target type='isa-serial' port='0'>
Aug 15 13:28:24 user nova-compute[72863]:         <model name='isa-serial'/>
Aug 15 13:28:24 user nova-compute[72863]:       </target>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </serial>
Aug 15 13:28:24 user nova-compute[72863]:     <console type='pty' tty='/dev/pts/4'>
Aug 15 13:28:24 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:24 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target type='serial' port='0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </console>
Aug 15 13:28:24 user nova-compute[72863]:     <input type='mouse' bus='ps2'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='input0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </input>
Aug 15 13:28:24 user nova-compute[72863]:     <input type='keyboard' bus='ps2'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='input1'/>
Aug 15 13:28:24 user nova-compute[72863]:     </input>
Aug 15 13:28:24 user nova-compute[72863]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 15 13:28:24 user nova-compute[72863]:       <listen type='address' address='0.0.0.0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </graphics>
Aug 15 13:28:24 user nova-compute[72863]:     <audio id='1' type='none'/>
Aug 15 13:28:24 user nova-compute[72863]:     <video>
Aug 15 13:28:24 user nova-compute[72863]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='video0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </video>
Aug 15 13:28:24 user nova-compute[72863]:     <memballoon model='virtio'>
Aug 15 13:28:24 user nova-compute[72863]:       <stats period='10'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='balloon0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:24 user nova-compute[72863]:     <rng model='virtio'>
Aug 15 13:28:24 user nova-compute[72863]:       <backend model='random'>/dev/urandom</backend>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='rng0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </rng>
Aug 15 13:28:24 user nova-compute[72863]:   </devices>
Aug 15 13:28:24 user nova-compute[72863]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 13:28:24 user nova-compute[72863]:     <label>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</label>
Aug 15 13:28:24 user nova-compute[72863]:     <imagelabel>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</imagelabel>
Aug 15 13:28:24 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:24 user nova-compute[72863]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 13:28:24 user nova-compute[72863]:     <label>+64055:+108</label>
Aug 15 13:28:24 user nova-compute[72863]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 13:28:24 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:24 user nova-compute[72863]: </domain>
Aug 15 13:28:24 user nova-compute[72863]:  {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface> {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2d:f5:5d"/><model type="virtio"/><mtu size="1442"/><target dev="tap80b425ec-96"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 15 13:28:24 user nova-compute[72863]:   <name>instance-0000000e</name>
Aug 15 13:28:24 user nova-compute[72863]:   <uuid>b3413aa3-879c-46a3-9495-24da1b2e28aa</uuid>
Aug 15 13:28:24 user nova-compute[72863]:   <metadata>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:24 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:23</nova:creationTime>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:24 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:24 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:24 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:24 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:24 user nova-compute[72863]:   </metadata>
Aug 15 13:28:24 user nova-compute[72863]:   <memory unit='KiB'>524288</memory>
Aug 15 13:28:24 user nova-compute[72863]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 13:28:24 user nova-compute[72863]:   <vcpu placement='static'>1</vcpu>
Aug 15 13:28:24 user nova-compute[72863]:   <resource>
Aug 15 13:28:24 user nova-compute[72863]:     <partition>/machine</partition>
Aug 15 13:28:24 user nova-compute[72863]:   </resource>
Aug 15 13:28:24 user nova-compute[72863]:   <sysinfo type='smbios'>
Aug 15 13:28:24 user nova-compute[72863]:     <system>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='version'>0.0.0</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='serial'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='uuid'>b3413aa3-879c-46a3-9495-24da1b2e28aa</entry>
Aug 15 13:28:24 user nova-compute[72863]:       <entry name='family'>Virtual Machine</entry>
Aug 15 13:28:24 user nova-compute[72863]:     </system>
Aug 15 13:28:24 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:24 user nova-compute[72863]:   <os>
Aug 15 13:28:24 user nova-compute[72863]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 13:28:24 user nova-compute[72863]:     <boot dev='hd'/>
Aug 15 13:28:24 user nova-compute[72863]:     <smbios mode='sysinfo'/>
Aug 15 13:28:24 user nova-compute[72863]:   </os>
Aug 15 13:28:24 user nova-compute[72863]:   <features>
Aug 15 13:28:24 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:24 user nova-compute[72863]:     <apic/>
Aug 15 13:28:24 user nova-compute[72863]:     <vmcoreinfo state='on'/>
Aug 15 13:28:24 user nova-compute[72863]:   </features>
Aug 15 13:28:24 user nova-compute[72863]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 13:28:24 user nova-compute[72863]:     <model fallback='forbid'>Nehalem</model>
Aug 15 13:28:24 user nova-compute[72863]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='vme'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='x2apic'/>
Aug 15 13:28:24 user nova-compute[72863]:     <feature policy='require' name='hypervisor'/>
Aug 15 13:28:24 user nova-compute[72863]:   </cpu>
Aug 15 13:28:24 user nova-compute[72863]:   <clock offset='utc'>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 13:28:24 user nova-compute[72863]:     <timer name='hpet' present='no'/>
Aug 15 13:28:24 user nova-compute[72863]:   </clock>
Aug 15 13:28:24 user nova-compute[72863]:   <on_poweroff>destroy</on_poweroff>
Aug 15 13:28:24 user nova-compute[72863]:   <on_reboot>restart</on_reboot>
Aug 15 13:28:24 user nova-compute[72863]:   <on_crash>destroy</on_crash>
Aug 15 13:28:24 user nova-compute[72863]:   <devices>
Aug 15 13:28:24 user nova-compute[72863]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 13:28:24 user nova-compute[72863]:     <disk type='file' device='disk'>
Aug 15 13:28:24 user nova-compute[72863]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 13:28:24 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk' index='2'/>
Aug 15 13:28:24 user nova-compute[72863]:       <backingStore type='file' index='3'>
Aug 15 13:28:24 user nova-compute[72863]:         <format type='raw'/>
Aug 15 13:28:24 user nova-compute[72863]:         <source file='/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14'/>
Aug 15 13:28:24 user nova-compute[72863]:         <backingStore/>
Aug 15 13:28:24 user nova-compute[72863]:       </backingStore>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='vda' bus='virtio'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='virtio-disk0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </disk>
Aug 15 13:28:24 user nova-compute[72863]:     <disk type='file' device='cdrom'>
Aug 15 13:28:24 user nova-compute[72863]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 13:28:24 user nova-compute[72863]:       <source file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/disk.config' index='1'/>
Aug 15 13:28:24 user nova-compute[72863]:       <backingStore/>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='hda' bus='ide'/>
Aug 15 13:28:24 user nova-compute[72863]:       <readonly/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='ide0-0-0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </disk>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='usb' index='0' model='none'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='usb'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='pci.0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <controller type='ide' index='0'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='ide'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 13:28:24 user nova-compute[72863]:     </controller>
Aug 15 13:28:24 user nova-compute[72863]:     <interface type='ethernet'>
Aug 15 13:28:24 user nova-compute[72863]:       <mac address='fa:16:3e:47:68:49'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target dev='tapccf2066c-f9'/>
Aug 15 13:28:24 user nova-compute[72863]:       <model type='virtio'/>
Aug 15 13:28:24 user nova-compute[72863]:       <mtu size='1442'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='net0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </interface>
Aug 15 13:28:24 user nova-compute[72863]:     <serial type='pty'>
Aug 15 13:28:24 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:24 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target type='isa-serial' port='0'>
Aug 15 13:28:24 user nova-compute[72863]:         <model name='isa-serial'/>
Aug 15 13:28:24 user nova-compute[72863]:       </target>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </serial>
Aug 15 13:28:24 user nova-compute[72863]:     <console type='pty' tty='/dev/pts/4'>
Aug 15 13:28:24 user nova-compute[72863]:       <source path='/dev/pts/4'/>
Aug 15 13:28:24 user nova-compute[72863]:       <log file='/opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa/console.log' append='off'/>
Aug 15 13:28:24 user nova-compute[72863]:       <target type='serial' port='0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='serial0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </console>
Aug 15 13:28:24 user nova-compute[72863]:     <input type='mouse' bus='ps2'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='input0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </input>
Aug 15 13:28:24 user nova-compute[72863]:     <input type='keyboard' bus='ps2'>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='input1'/>
Aug 15 13:28:24 user nova-compute[72863]:     </input>
Aug 15 13:28:24 user nova-compute[72863]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 15 13:28:24 user nova-compute[72863]:       <listen type='address' address='0.0.0.0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </graphics>
Aug 15 13:28:24 user nova-compute[72863]:     <audio id='1' type='none'/>
Aug 15 13:28:24 user nova-compute[72863]:     <video>
Aug 15 13:28:24 user nova-compute[72863]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='video0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </video>
Aug 15 13:28:24 user nova-compute[72863]:     <memballoon model='virtio'>
Aug 15 13:28:24 user nova-compute[72863]:       <stats period='10'/>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='balloon0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:24 user nova-compute[72863]:     <rng model='virtio'>
Aug 15 13:28:24 user nova-compute[72863]:       <backend model='random'>/dev/urandom</backend>
Aug 15 13:28:24 user nova-compute[72863]:       <alias name='rng0'/>
Aug 15 13:28:24 user nova-compute[72863]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 13:28:24 user nova-compute[72863]:     </rng>
Aug 15 13:28:24 user nova-compute[72863]:   </devices>
Aug 15 13:28:24 user nova-compute[72863]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 13:28:24 user nova-compute[72863]:     <label>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</label>
Aug 15 13:28:24 user nova-compute[72863]:     <imagelabel>libvirt-b3413aa3-879c-46a3-9495-24da1b2e28aa</imagelabel>
Aug 15 13:28:24 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:24 user nova-compute[72863]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 13:28:24 user nova-compute[72863]:     <label>+64055:+108</label>
Aug 15 13:28:24 user nova-compute[72863]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 13:28:24 user nova-compute[72863]:   </seclabel>
Aug 15 13:28:24 user nova-compute[72863]: </domain>
Aug 15 13:28:24 user nova-compute[72863]:  {{(pid=72863) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 13:28:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Detaching interface fa:16:3e:2d:f5:5d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap80b425ec-96' not found.
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Converting VIF {"id": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "address": "fa:16:3e:2d:f5:5d", "network": {"id": "1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-588720707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b425ec-96", "ovs_interfaceid": "80b425ec-96e9-4c79-b7f6-b5d6cf6d4629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG os_vif [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b425ec-96, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:24 user nova-compute[72863]: INFO os_vif [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f5:5d,bridge_name='br-int',has_traffic_filtering=True,id=80b425ec-96e9-4c79-b7f6-b5d6cf6d4629,network=Network(1c6ca9ac-d2dd-4b7d-b7a6-6285dff311dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b425ec-96')
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [req-ff7fef9c-3601-4d78-b897-e488c5352e7f req-7329859d-7383-48d9-ac07-9c4f3e7beb88 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:24 user nova-compute[72863]:   <nova:package version="0.0.0"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:name>tempest-device-tagging-server-1955670837</nova:name>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:creationTime>2023-08-15 13:28:24</nova:creationTime>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:flavor name="m1.tiny">
Aug 15 13:28:24 user nova-compute[72863]:     <nova:memory>512</nova:memory>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:disk>1</nova:disk>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:swap>0</nova:swap>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:flavor>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:user uuid="80f4012d293141f89e66f6ea556ca0da">tempest-TaggedAttachmentsTest-1751160429-project-member</nova:user>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:project uuid="7951b03c2da44b6bbb7c5f0746ddd02f">tempest-TaggedAttachmentsTest-1751160429</nova:project>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:owner>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:24 user nova-compute[72863]:   <nova:ports>
Aug 15 13:28:24 user nova-compute[72863]:     <nova:port uuid="ccf2066c-f978-45c7-a691-ee40af7095cb">
Aug 15 13:28:24 user nova-compute[72863]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:28:24 user nova-compute[72863]:     </nova:port>
Aug 15 13:28:24 user nova-compute[72863]:   </nova:ports>
Aug 15 13:28:24 user nova-compute[72863]: </nova:instance>
Aug 15 13:28:24 user nova-compute[72863]:  {{(pid=72863) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [{"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Releasing lock "refresh_cache-b3413aa3-879c-46a3-9495-24da1b2e28aa" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c1dd71e-8163-4ba0-bb14-b949a4c76cd6 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "interface-b3413aa3-879c-46a3-9495-24da1b2e28aa-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.207s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:28:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Snapshot image upload complete
Aug 15 13:28:25 user nova-compute[72863]: INFO nova.compute.manager [None req-2ed2867b-8830-493d-9988-3d51ddcb75dd tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Took 6.95 seconds to snapshot the instance on the hypervisor.
Aug 15 13:28:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:25 user nova-compute[72863]: WARNING nova.compute.manager [req-4d755631-5952-43ef-9d08-b51bd0286f71 req-542e7cad-fd19-46a7-9221-a770c9711f38 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-80b425ec-96e9-4c79-b7f6-b5d6cf6d4629 for instance with vm_state active and task_state None.
Aug 15 13:28:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:27 user nova-compute[72863]: INFO nova.compute.manager [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Terminating instance
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Instance destroyed successfully.
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'resources' on Instance uuid e4ef0481-3cff-49a0-8c93-eab77a8e923a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-245479421',display_name='tempest-VolumesAdminNegativeTest-server-245479421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-245479421',id=15,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-p1dsjoc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:29Z,user_data=None,user_id='0de57a132def47359f74cad70c1b2a4f',uuid=e4ef0481-3cff-49a0-8c93-eab77a8e923a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "address": "fa:16:3e:d4:d4:47", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ac1f7b-de", "ovs_interfaceid": "65ac1f7b-de96-45cc-bef8-aae2b963a78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG os_vif [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65ac1f7b-de, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:27 user nova-compute[72863]: INFO os_vif [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:d4:47,bridge_name='br-int',has_traffic_filtering=True,id=65ac1f7b-de96-45cc-bef8-aae2b963a78f,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ac1f7b-de')
Aug 15 13:28:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Deleting instance files /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a_del
Aug 15 13:28:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Deletion of /opt/stack/data/nova/instances/e4ef0481-3cff-49a0-8c93-eab77a8e923a_del complete
Aug 15 13:28:27 user nova-compute[72863]: INFO nova.compute.manager [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 15 13:28:27 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:28:27 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:28:28 user nova-compute[72863]: INFO nova.compute.claims [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Claim successful on node user
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.038s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:28:29 user nova-compute[72863]: INFO nova.compute.claims [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Claim successful on node user
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:28:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.policy [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ca7fc8e0234907a0c702f5058880f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5389f772e56e4039a074a8df8ba6cb05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:29 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Took 1.70 seconds to deallocate network for instance.
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-96d7a0c4-9f7b-4a69-b7e8-41f84cc13a56 req-01820391-6318-45fc-9c55-d2279c2b3331 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Received event network-vif-deleted-65ac1f7b-de96-45cc-bef8-aae2b963a78f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:29 user nova-compute[72863]: INFO nova.compute.manager [req-96d7a0c4-9f7b-4a69-b7e8-41f84cc13a56 req-01820391-6318-45fc-9c55-d2279c2b3331 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Neutron deleted interface 65ac1f7b-de96-45cc-bef8-aae2b963a78f; detaching it from the instance and deleting it from the info cache
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-96d7a0c4-9f7b-4a69-b7e8-41f84cc13a56 req-01820391-6318-45fc-9c55-d2279c2b3331 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-96d7a0c4-9f7b-4a69-b7e8-41f84cc13a56 req-01820391-6318-45fc-9c55-d2279c2b3331 service nova] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Detach interface failed, port_id=65ac1f7b-de96-45cc-bef8-aae2b963a78f, reason: Instance e4ef0481-3cff-49a0-8c93-eab77a8e923a could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing instance network info cache due to event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:28:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Creating image(s)
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.809s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.364s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.262s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk 1073741824" returned: 0 in 0.076s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:30 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.policy [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ca7fc8e0234907a0c702f5058880f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5389f772e56e4039a074a8df8ba6cb05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:28:30 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Creating image(s)
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Cannot resize image /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Ensure instance console log exists: /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated VIF entry in instance network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Successfully created port: 598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d329a9d7-d07b-4e85-a61a-1362fa1a8796 req-4e673b1d-0aa3-4f32-973b-dfc1c6f75826 service nova] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.807s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:31 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Deleted allocations for instance e4ef0481-3cff-49a0-8c93-eab77a8e923a
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f531f60-9443-4b00-ab22-f9af9fea2aa7 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "e4ef0481-3cff-49a0-8c93-eab77a8e923a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.957s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.227s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk 1073741824" returned: 0 in 0.054s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Cannot resize image /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG nova.objects.instance [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Ensure instance console log exists: /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Successfully updated port: 598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-changed-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Refreshing instance network info cache due to event network-changed-598a82a2-20af-48a4-9465-b83e9d9e6b70. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Successfully created port: 06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance network_info: |[{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Refreshing network info cache for port 598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start _get_guest_xml network_info=[{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:28:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1057708234',display_name='tempest-ServerRescueNegativeTestJSON-server-1057708234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1057708234',id=19,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-jyhasptx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:30Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=eb797116-28dc-481b-af43-439920b4f269,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:28:33 user nova-compute[72863]:   <uuid>eb797116-28dc-481b-af43-439920b4f269</uuid>
Aug 15 13:28:33 user nova-compute[72863]:   <name>instance-00000013</name>
Aug 15 13:28:33 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:28:33 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:28:33 user nova-compute[72863]:   <metadata>
Aug 15 13:28:33 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:33 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1057708234</nova:name>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:28:33</nova:creationTime>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:28:33 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:33 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:owner>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:28:33 user nova-compute[72863]:       </nova:owner>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:33 user nova-compute[72863]:       <nova:ports>
Aug 15 13:28:33 user nova-compute[72863]:         <nova:port uuid="598a82a2-20af-48a4-9465-b83e9d9e6b70">
Aug 15 13:28:33 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 13:28:33 user nova-compute[72863]:         </nova:port>
Aug 15 13:28:33 user nova-compute[72863]:       </nova:ports>
Aug 15 13:28:33 user nova-compute[72863]:     </nova:instance>
Aug 15 13:28:33 user nova-compute[72863]:   </metadata>
Aug 15 13:28:33 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:28:33 user nova-compute[72863]:     <system>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="serial">eb797116-28dc-481b-af43-439920b4f269</entry>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="uuid">eb797116-28dc-481b-af43-439920b4f269</entry>
Aug 15 13:28:33 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:28:33 user nova-compute[72863]:     </system>
Aug 15 13:28:33 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:33 user nova-compute[72863]:   <os>
Aug 15 13:28:33 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:28:33 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:28:33 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:28:33 user nova-compute[72863]:   </os>
Aug 15 13:28:33 user nova-compute[72863]:   <features>
Aug 15 13:28:33 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:33 user nova-compute[72863]:     <apic/>
Aug 15 13:28:33 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:28:33 user nova-compute[72863]:   </features>
Aug 15 13:28:33 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:28:33 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:28:33 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:28:33 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:28:33 user nova-compute[72863]:   </clock>
Aug 15 13:28:33 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:28:33 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:28:33 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:28:33 user nova-compute[72863]:   </cpu>
Aug 15 13:28:33 user nova-compute[72863]:   <devices>
Aug 15 13:28:33 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:28:33 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:28:33 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk"/>
Aug 15 13:28:33 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:28:33 user nova-compute[72863]:     </disk>
Aug 15 13:28:33 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:28:33 user nova-compute[72863]:       <mac address="fa:16:3e:ed:e0:62"/>
Aug 15 13:28:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:33 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:28:33 user nova-compute[72863]:       <target dev="tap598a82a2-20"/>
Aug 15 13:28:33 user nova-compute[72863]:     </interface>
Aug 15 13:28:33 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:28:33 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/console.log" append="off"/>
Aug 15 13:28:33 user nova-compute[72863]:     </serial>
Aug 15 13:28:33 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:28:33 user nova-compute[72863]:     <video>
Aug 15 13:28:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:33 user nova-compute[72863]:     </video>
Aug 15 13:28:33 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:28:33 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:28:33 user nova-compute[72863]:     </rng>
Aug 15 13:28:33 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:28:33 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:28:33 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:28:33 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:33 user nova-compute[72863]:   </devices>
Aug 15 13:28:33 user nova-compute[72863]: </domain>
Aug 15 13:28:33 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1057708234',display_name='tempest-ServerRescueNegativeTestJSON-server-1057708234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1057708234',id=19,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-jyhasptx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:30Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=eb797116-28dc-481b-af43-439920b4f269,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG os_vif [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598a82a2-20, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap598a82a2-20, col_values=(('external_ids', {'iface-id': '598a82a2-20af-48a4-9465-b83e9d9e6b70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e0:62', 'vm-uuid': 'eb797116-28dc-481b-af43-439920b4f269'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:33 user nova-compute[72863]: INFO os_vif [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20')
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:ed:e0:62, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Updated VIF entry in instance network info cache for port 598a82a2-20af-48a4-9465-b83e9d9e6b70. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-052786c2-7fe9-4227-a841-8c22d5e35e7f req-d9878ddb-1f21-40bb-a3db-a98cb21f7730 service nova] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Successfully updated port: 06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-changed-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Refreshing instance network info cache due to event network-changed-06aadf08-917e-498a-80a8-2428643011e1. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_power_states {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:28:34 user nova-compute[72863]: WARNING nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "772fe730-8857-4520-9006-3972b660b933" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "772fe730-8857-4520-9006-3972b660b933" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "772fe730-8857-4520-9006-3972b660b933" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance network_info: |[{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Refreshing network info cache for port 06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start _get_guest_xml network_info=[{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:28:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1773750799',display_name='tempest-ServerRescueNegativeTestJSON-server-1773750799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1773750799',id=20,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-uwt2f1bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:31Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=9fdc0841-80ef-48d8-83bc-db09fa20144e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:28:35 user nova-compute[72863]:   <uuid>9fdc0841-80ef-48d8-83bc-db09fa20144e</uuid>
Aug 15 13:28:35 user nova-compute[72863]:   <name>instance-00000014</name>
Aug 15 13:28:35 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:28:35 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:28:35 user nova-compute[72863]:   <metadata>
Aug 15 13:28:35 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:35 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1773750799</nova:name>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:28:35</nova:creationTime>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:28:35 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:35 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:owner>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:28:35 user nova-compute[72863]:       </nova:owner>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:35 user nova-compute[72863]:       <nova:ports>
Aug 15 13:28:35 user nova-compute[72863]:         <nova:port uuid="06aadf08-917e-498a-80a8-2428643011e1">
Aug 15 13:28:35 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 13:28:35 user nova-compute[72863]:         </nova:port>
Aug 15 13:28:35 user nova-compute[72863]:       </nova:ports>
Aug 15 13:28:35 user nova-compute[72863]:     </nova:instance>
Aug 15 13:28:35 user nova-compute[72863]:   </metadata>
Aug 15 13:28:35 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:28:35 user nova-compute[72863]:     <system>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="serial">9fdc0841-80ef-48d8-83bc-db09fa20144e</entry>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="uuid">9fdc0841-80ef-48d8-83bc-db09fa20144e</entry>
Aug 15 13:28:35 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:28:35 user nova-compute[72863]:     </system>
Aug 15 13:28:35 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:35 user nova-compute[72863]:   <os>
Aug 15 13:28:35 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:28:35 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:28:35 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:28:35 user nova-compute[72863]:   </os>
Aug 15 13:28:35 user nova-compute[72863]:   <features>
Aug 15 13:28:35 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:35 user nova-compute[72863]:     <apic/>
Aug 15 13:28:35 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:28:35 user nova-compute[72863]:   </features>
Aug 15 13:28:35 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:28:35 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:28:35 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:28:35 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:28:35 user nova-compute[72863]:   </clock>
Aug 15 13:28:35 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:28:35 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:28:35 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:28:35 user nova-compute[72863]:   </cpu>
Aug 15 13:28:35 user nova-compute[72863]:   <devices>
Aug 15 13:28:35 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:28:35 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:28:35 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk"/>
Aug 15 13:28:35 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:28:35 user nova-compute[72863]:     </disk>
Aug 15 13:28:35 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:28:35 user nova-compute[72863]:       <mac address="fa:16:3e:bb:5c:75"/>
Aug 15 13:28:35 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:35 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:28:35 user nova-compute[72863]:       <target dev="tap06aadf08-91"/>
Aug 15 13:28:35 user nova-compute[72863]:     </interface>
Aug 15 13:28:35 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:28:35 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/console.log" append="off"/>
Aug 15 13:28:35 user nova-compute[72863]:     </serial>
Aug 15 13:28:35 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:28:35 user nova-compute[72863]:     <video>
Aug 15 13:28:35 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:35 user nova-compute[72863]:     </video>
Aug 15 13:28:35 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:28:35 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:28:35 user nova-compute[72863]:     </rng>
Aug 15 13:28:35 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:28:35 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:28:35 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:28:35 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:35 user nova-compute[72863]:   </devices>
Aug 15 13:28:35 user nova-compute[72863]: </domain>
Aug 15 13:28:35 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1773750799',display_name='tempest-ServerRescueNegativeTestJSON-server-1773750799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1773750799',id=20,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-uwt2f1bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:31Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=9fdc0841-80ef-48d8-83bc-db09fa20144e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG os_vif [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06aadf08-91, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06aadf08-91, col_values=(('external_ids', {'iface-id': '06aadf08-917e-498a-80a8-2428643011e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:5c:75', 'vm-uuid': '9fdc0841-80ef-48d8-83bc-db09fa20144e'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:35 user nova-compute[72863]: INFO os_vif [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91')
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:bb:5c:75, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updated VIF entry in instance network info cache for port 06aadf08-917e-498a-80a8-2428643011e1. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6f5d29e-ec9f-4220-b05e-3c54e722f93b req-9da17e75-800b-4c74-8923-53eba236a97f service nova] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:36 user nova-compute[72863]: WARNING nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state building and task_state spawning.
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:36 user nova-compute[72863]: WARNING nova.compute.manager [req-e0ccd057-0baa-410e-b235-b7fceff7463b req-438f9269-8c4a-4eed-ad75-d43457af3d2d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state building and task_state spawning.
Aug 15 13:28:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106116.7934499, eb797116-28dc-481b-af43-439920b4f269 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Resumed (Lifecycle Event)
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance spawned successfully.
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106116.797781, eb797116-28dc-481b-af43-439920b4f269 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Started (Lifecycle Event)
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:36 user nova-compute[72863]: INFO nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Took 7.16 seconds to spawn the instance on the hypervisor.
Aug 15 13:28:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:37 user nova-compute[72863]: INFO nova.compute.manager [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Took 8.22 seconds to build instance.
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1c317c56-8426-48b9-b1e2-aac0398b97d5 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.406s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "eb797116-28dc-481b-af43-439920b4f269" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.115s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:37 user nova-compute[72863]: INFO nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "eb797116-28dc-481b-af43-439920b4f269" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:37 user nova-compute[72863]: WARNING nova.compute.manager [req-38635cb3-e8f5-4b7a-a07c-037a92924d07 req-278002c9-9664-4918-b46d-91ba91a60371 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state building and task_state spawning.
Aug 15 13:28:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:38 user nova-compute[72863]: INFO nova.compute.manager [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Terminating instance
Aug 15 13:28:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Detaching volume 04eda795-d566-42e7-bbc8-393bd0b46b93
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106119.2614791, 9fdc0841-80ef-48d8-83bc-db09fa20144e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] VM Resumed (Lifecycle Event)
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance spawned successfully.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.block_device [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Attempting to driver detach volume 04eda795-d566-42e7-bbc8-393bd0b46b93 from mountpoint /dev/vdb
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:39 user nova-compute[72863]: WARNING nova.compute.manager [req-1a490499-e071-4807-b6f9-60282c8bff66 req-34fb0080-e3fd-4f0f-89c8-f8c918ea3e5d service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state building and task_state spawning.
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106119.2673461, 9fdc0841-80ef-48d8-83bc-db09fa20144e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] VM Started (Lifecycle Event)
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-unplugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] No waiting events found dispatching network-vif-unplugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-f68a4c64-29bf-4f71-af3f-f38f51e6b5f8 req-39580a26-e372-4a47-962c-a51d2c6c5463 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-unplugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.claims [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Claim successful on node user
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Attempting to detach device vdb from instance 86c46771-bc19-4440-9ed1-d713a003b231 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:28:39 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:28:39 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:28:39 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:28:39 user nova-compute[72863]:   <serial>04eda795-d566-42e7-bbc8-393bd0b46b93</serial>
Aug 15 13:28:39 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:28:39 user nova-compute[72863]: </disk>
Aug 15 13:28:39 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Instance destroyed successfully.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.objects.instance [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'resources' on Instance uuid 8518b46b-8053-41e4-9c1f-9b4215965ddc {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdb from instance 86c46771-bc19-4440-9ed1-d713a003b231 from the persistent domain config.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86c46771-bc19-4440-9ed1-d713a003b231 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:28:39 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:28:39 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:28:39 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:28:39 user nova-compute[72863]:   <serial>04eda795-d566-42e7-bbc8-393bd0b46b93</serial>
Aug 15 13:28:39 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:28:39 user nova-compute[72863]: </disk>
Aug 15 13:28:39 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187699649',display_name='tempest-AttachVolumeNegativeTest-server-187699649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187699649',id=3,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8lvuZhOrpfI+d9UYXSQulIgcyuvtXmyYpk+1tHxBQkMZEniDO3qADAcHc8uTk7jEUQwWD50axb0igZfxjy6g6lb19gJcTEs3qv1YQJVGaxAkddA6o67Udb7sM7P2xMww==',key_name='tempest-keypair-1360471551',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-xigkicsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=8518b46b-8053-41e4-9c1f-9b4215965ddc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "address": "fa:16:3e:0c:62:32", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2b3c24-f1", "ovs_interfaceid": "4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG os_vif [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b2b3c24-f1, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:39 user nova-compute[72863]: INFO os_vif [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:62:32,bridge_name='br-int',has_traffic_filtering=True,id=4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2b3c24-f1')
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Deleting instance files /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc_del
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Deletion of /opt/stack/data/nova/instances/8518b46b-8053-41e4-9c1f-9b4215965ddc_del complete
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Took 9.09 seconds to spawn the instance on the hypervisor.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Took 10.63 seconds to build instance.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-acf4c0c5-8a45-4d17-8324-29b5d34804c4 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.764s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.017s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:39 user nova-compute[72863]: INFO nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106120.2793016, 86c46771-bc19-4440-9ed1-d713a003b231 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:28:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdb from instance 86c46771-bc19-4440-9ed1-d713a003b231 from the live domain config.
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XohbjkDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:28:40 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9db75-ba8c-4c0d-bdcd-77040c10ee4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14935792-751b-47d3-9fc2-47b8bb21fe9a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:40 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 (non-flash)
Aug 15 13:28:40 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c3a2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f26961-f95e-459f-b631-bd5766aa51dc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0854e6e-5646-4f7c-bf08-347e15280c9d]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6480ccc-cfd1-4f6f-997e-70902e0b334a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb633498-b6eb-41cc-9f8a-73e44d35d947]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4458030c-cc00-4340-9375-6dd8399af90e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe138a7-c12d-443f-95af-676074a756f9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260]
Aug 15 13:28:40 user nova-compute[72863]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93, portal: 172.16.0.220,3260] successful.
Aug 15 13:28:40 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.987s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04eda795-d566-42e7-bbc8-393bd0b46b93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3fa797-6814-4288-8719-1ce282a04158]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== disconnect_volume: return (396ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:28:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:28:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Creating image(s)
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "/opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "/opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "/opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.policy [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fed10e3f5c747719e8894168cdc5546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baba30e66ae4f9bad5a891c97ac4650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.234s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk 1073741824" returned: 0 in 0.062s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] Acquiring lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] No waiting events found dispatching network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:41 user nova-compute[72863]: WARNING nova.compute.manager [req-91ba9040-86ae-4d58-a967-9fc9dd06186e req-c6843786-0271-4c7b-b969-55ff1b8bbdfa service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received unexpected event network-vif-plugged-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 for instance with vm_state active and task_state deleting.
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:41 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Took 1.69 seconds to deallocate network for instance.
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.244s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Cannot resize image /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'migration_context' on Instance uuid 212b0da2-d0da-4920-b26a-f7143ae7840f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Ensure instance console log exists: /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8c8363f6-cb98-464f-af07-ecb2c29e39fd tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.970s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.692s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:42 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Deleted allocations for instance 8518b46b-8053-41e4-9c1f-9b4215965ddc
Aug 15 13:28:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-40a12f56-97da-4abf-83fb-681f7b8f6ee8 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "8518b46b-8053-41e4-9c1f-9b4215965ddc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.026s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72863) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106107.8285792, e4ef0481-3cff-49a0-8c93-eab77a8e923a => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:42 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] VM Stopped (Lifecycle Event)
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-727bd8aa-b5db-449b-b2e2-62fdacce1074 None None] [instance: e4ef0481-3cff-49a0-8c93-eab77a8e923a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Successfully created port: c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:28:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance destroyed successfully.
Aug 15 13:28:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-ca2dc5c8-d89e-492a-9963-7e58a3346249 req-8d4b98d4-16c2-4f44-b159-29142d4e01b1 service nova] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Received event network-vif-deleted-4b2b3c24-f160-4d9b-bf5d-bd3b292a0d01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57b7225e-6ed0-47d1-8522-49f34b5bc976 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.961s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Successfully updated port: c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquired lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-changed-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Refreshing instance network info cache due to event network-changed-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] Acquiring lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updating instance_info_cache with network_info: [{"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Releasing lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Instance network_info: |[{"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] Acquired lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Refreshing network info cache for port c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Start _get_guest_xml network_info=[{"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:28:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1645964417',display_name='tempest-ServersNegativeTestJSON-server-1645964417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1645964417',id=21,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-6ldlf6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:41Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=212b0da2-d0da-4920-b26a-f7143ae7840f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'pci_devices' on Instance uuid 212b0da2-d0da-4920-b26a-f7143ae7840f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:28:46 user nova-compute[72863]:   <uuid>212b0da2-d0da-4920-b26a-f7143ae7840f</uuid>
Aug 15 13:28:46 user nova-compute[72863]:   <name>instance-00000015</name>
Aug 15 13:28:46 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:28:46 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:28:46 user nova-compute[72863]:   <metadata>
Aug 15 13:28:46 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:46 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:name>tempest-ServersNegativeTestJSON-server-1645964417</nova:name>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:28:46</nova:creationTime>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:28:46 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:46 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:owner>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:user uuid="9fed10e3f5c747719e8894168cdc5546">tempest-ServersNegativeTestJSON-2047494063-project-member</nova:user>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:project uuid="3baba30e66ae4f9bad5a891c97ac4650">tempest-ServersNegativeTestJSON-2047494063</nova:project>
Aug 15 13:28:46 user nova-compute[72863]:       </nova:owner>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:46 user nova-compute[72863]:       <nova:ports>
Aug 15 13:28:46 user nova-compute[72863]:         <nova:port uuid="c70c24af-7528-4cc6-aa5b-51c4aaa23bcf">
Aug 15 13:28:46 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 13:28:46 user nova-compute[72863]:         </nova:port>
Aug 15 13:28:46 user nova-compute[72863]:       </nova:ports>
Aug 15 13:28:46 user nova-compute[72863]:     </nova:instance>
Aug 15 13:28:46 user nova-compute[72863]:   </metadata>
Aug 15 13:28:46 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:28:46 user nova-compute[72863]:     <system>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="serial">212b0da2-d0da-4920-b26a-f7143ae7840f</entry>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="uuid">212b0da2-d0da-4920-b26a-f7143ae7840f</entry>
Aug 15 13:28:46 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:28:46 user nova-compute[72863]:     </system>
Aug 15 13:28:46 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:46 user nova-compute[72863]:   <os>
Aug 15 13:28:46 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:28:46 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:28:46 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:28:46 user nova-compute[72863]:   </os>
Aug 15 13:28:46 user nova-compute[72863]:   <features>
Aug 15 13:28:46 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:46 user nova-compute[72863]:     <apic/>
Aug 15 13:28:46 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:28:46 user nova-compute[72863]:   </features>
Aug 15 13:28:46 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:28:46 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:28:46 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:28:46 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:28:46 user nova-compute[72863]:   </clock>
Aug 15 13:28:46 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:28:46 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:28:46 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:28:46 user nova-compute[72863]:   </cpu>
Aug 15 13:28:46 user nova-compute[72863]:   <devices>
Aug 15 13:28:46 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:28:46 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:28:46 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk"/>
Aug 15 13:28:46 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:28:46 user nova-compute[72863]:     </disk>
Aug 15 13:28:46 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:28:46 user nova-compute[72863]:       <mac address="fa:16:3e:4f:ea:d0"/>
Aug 15 13:28:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:46 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:28:46 user nova-compute[72863]:       <target dev="tapc70c24af-75"/>
Aug 15 13:28:46 user nova-compute[72863]:     </interface>
Aug 15 13:28:46 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:28:46 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/console.log" append="off"/>
Aug 15 13:28:46 user nova-compute[72863]:     </serial>
Aug 15 13:28:46 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:28:46 user nova-compute[72863]:     <video>
Aug 15 13:28:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:46 user nova-compute[72863]:     </video>
Aug 15 13:28:46 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:28:46 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:28:46 user nova-compute[72863]:     </rng>
Aug 15 13:28:46 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:28:46 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:28:46 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:28:46 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:46 user nova-compute[72863]:   </devices>
Aug 15 13:28:46 user nova-compute[72863]: </domain>
Aug 15 13:28:46 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1645964417',display_name='tempest-ServersNegativeTestJSON-server-1645964417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1645964417',id=21,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-6ldlf6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:41Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=212b0da2-d0da-4920-b26a-f7143ae7840f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG os_vif [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc70c24af-75, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc70c24af-75, col_values=(('external_ids', {'iface-id': 'c70c24af-7528-4cc6-aa5b-51c4aaa23bcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:ea:d0', 'vm-uuid': '212b0da2-d0da-4920-b26a-f7143ae7840f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:46 user nova-compute[72863]: INFO os_vif [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75')
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] No VIF found with MAC fa:16:3e:4f:ea:d0, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:47 user nova-compute[72863]: WARNING nova.compute.manager [req-fbeec6c2-f6a7-4b9a-ac8e-9970e4f0c0d2 req-fac06bdb-cfe7-4ba7-9d11-7f61c3bccab0 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state None.
Aug 15 13:28:48 user nova-compute[72863]: DEBUG nova.network.neutron [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updated VIF entry in instance network info cache for port c70c24af-7528-4cc6-aa5b-51c4aaa23bcf. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG nova.network.neutron [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updating instance_info_cache with network_info: [{"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0c474459-b2ef-4902-a964-a6cf33d3c4d5 req-6f252a54-2a8f-4963-884f-7be8f979efe8 service nova] Releasing lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] No waiting events found dispatching network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:48 user nova-compute[72863]: WARNING nova.compute.manager [req-108fa222-4b7b-4abd-98b5-5217dcfd9072 req-60d3b9c4-88b0-4152-ad49-a9f6a8330920 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received unexpected event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf for instance with vm_state building and task_state spawning.
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:28:49 user nova-compute[72863]: INFO nova.compute.claims [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Claim successful on node user
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:49 user nova-compute[72863]: WARNING nova.compute.manager [req-14f235cb-dd64-4ef1-a268-3138e746403c req-720ab24b-1c22-4101-9d89-b9e67c50a7ea service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state None.
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:28:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.policy [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c38ea4a412d4cb8ad2e8b7f89c3d5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfea57273354f118f2cdc6734d0d796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:28:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Creating image(s)
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk 1073741824" returned: 0 in 0.084s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Successfully created port: a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106130.7674646, 212b0da2-d0da-4920-b26a-f7143ae7840f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] VM Resumed (Lifecycle Event)
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Instance spawned successfully.
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] No waiting events found dispatching network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:50 user nova-compute[72863]: WARNING nova.compute.manager [req-b3f09b38-fa57-4062-87a1-e2760a6cc264 req-84abb300-81f2-45ac-894c-b3721b42074f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received unexpected event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf for instance with vm_state building and task_state spawning.
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106130.783919, 212b0da2-d0da-4920-b26a-f7143ae7840f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] VM Started (Lifecycle Event)
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Cannot resize image /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'migration_context' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:50 user nova-compute[72863]: INFO nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Took 10.00 seconds to spawn the instance on the hypervisor.
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Ensure instance console log exists: /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:51 user nova-compute[72863]: INFO nova.compute.manager [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Took 11.81 seconds to build instance.
Aug 15 13:28:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0c98e7bc-d250-4d03-a5d0-9a2c617635d0 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.965s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Successfully updated port: a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:28:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.neutron [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance network_info: |[{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start _get_guest_xml network_info=[{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:28:52 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:52 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.objects.instance [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'pci_devices' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:28:52 user nova-compute[72863]:   <uuid>314a7b77-4fbc-4184-add3-7f1e44aa7b0f</uuid>
Aug 15 13:28:52 user nova-compute[72863]:   <name>instance-00000016</name>
Aug 15 13:28:52 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:28:52 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:28:52 user nova-compute[72863]:   <metadata>
Aug 15 13:28:52 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:28:52 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherB-server-1841832683</nova:name>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:28:52</nova:creationTime>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:28:52 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:28:52 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:owner>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:user uuid="5c38ea4a412d4cb8ad2e8b7f89c3d5c4">tempest-ServerActionsTestOtherB-852730704-project-member</nova:user>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:project uuid="6cfea57273354f118f2cdc6734d0d796">tempest-ServerActionsTestOtherB-852730704</nova:project>
Aug 15 13:28:52 user nova-compute[72863]:       </nova:owner>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:28:52 user nova-compute[72863]:       <nova:ports>
Aug 15 13:28:52 user nova-compute[72863]:         <nova:port uuid="a249e220-f1eb-4dee-9aaf-f12953a48bbd">
Aug 15 13:28:52 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 13:28:52 user nova-compute[72863]:         </nova:port>
Aug 15 13:28:52 user nova-compute[72863]:       </nova:ports>
Aug 15 13:28:52 user nova-compute[72863]:     </nova:instance>
Aug 15 13:28:52 user nova-compute[72863]:   </metadata>
Aug 15 13:28:52 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:28:52 user nova-compute[72863]:     <system>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="serial">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="uuid">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:28:52 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:28:52 user nova-compute[72863]:     </system>
Aug 15 13:28:52 user nova-compute[72863]:   </sysinfo>
Aug 15 13:28:52 user nova-compute[72863]:   <os>
Aug 15 13:28:52 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:28:52 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:28:52 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:28:52 user nova-compute[72863]:   </os>
Aug 15 13:28:52 user nova-compute[72863]:   <features>
Aug 15 13:28:52 user nova-compute[72863]:     <acpi/>
Aug 15 13:28:52 user nova-compute[72863]:     <apic/>
Aug 15 13:28:52 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:28:52 user nova-compute[72863]:   </features>
Aug 15 13:28:52 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:28:52 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:28:52 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:28:52 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:28:52 user nova-compute[72863]:   </clock>
Aug 15 13:28:52 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:28:52 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:28:52 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:28:52 user nova-compute[72863]:   </cpu>
Aug 15 13:28:52 user nova-compute[72863]:   <devices>
Aug 15 13:28:52 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:28:52 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:28:52 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk"/>
Aug 15 13:28:52 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:28:52 user nova-compute[72863]:     </disk>
Aug 15 13:28:52 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:28:52 user nova-compute[72863]:       <mac address="fa:16:3e:ca:73:dd"/>
Aug 15 13:28:52 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:52 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:28:52 user nova-compute[72863]:       <target dev="tapa249e220-f1"/>
Aug 15 13:28:52 user nova-compute[72863]:     </interface>
Aug 15 13:28:52 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:28:52 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/console.log" append="off"/>
Aug 15 13:28:52 user nova-compute[72863]:     </serial>
Aug 15 13:28:52 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:28:52 user nova-compute[72863]:     <video>
Aug 15 13:28:52 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:28:52 user nova-compute[72863]:     </video>
Aug 15 13:28:52 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:28:52 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:28:52 user nova-compute[72863]:     </rng>
Aug 15 13:28:52 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:28:52 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:28:52 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:28:52 user nova-compute[72863]:     </memballoon>
Aug 15 13:28:52 user nova-compute[72863]:   </devices>
Aug 15 13:28:52 user nova-compute[72863]: </domain>
Aug 15 13:28:52 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG os_vif [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa249e220-f1, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa249e220-f1, col_values=(('external_ids', {'iface-id': 'a249e220-f1eb-4dee-9aaf-f12953a48bbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:73:dd', 'vm-uuid': '314a7b77-4fbc-4184-add3-7f1e44aa7b0f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:52 user nova-compute[72863]: INFO os_vif [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No VIF found with MAC fa:16:3e:ca:73:dd, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-changed-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Refreshing instance network info cache due to event network-changed-a249e220-f1eb-4dee-9aaf-f12953a48bbd. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:28:52 user nova-compute[72863]: DEBUG nova.network.neutron [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Refreshing network info cache for port a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updated VIF entry in instance network info cache for port a249e220-f1eb-4dee-9aaf-f12953a48bbd. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad9a55fe-3061-4e7e-83d4-e3c8d4e1bd3f req-a41218e3-433b-425e-aed3-1ea0ac7d746d service nova] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:54 user nova-compute[72863]: WARNING nova.compute.manager [req-7c2ffd0e-2728-4218-900e-61ff49ecda6b req-d28bb600-903f-4820-aaaf-c4e94e68b687 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state building and task_state spawning.
Aug 15 13:28:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:54 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106119.65957, 8518b46b-8053-41e4-9c1f-9b4215965ddc => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:54 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] VM Stopped (Lifecycle Event)
Aug 15 13:28:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e3e1e364-1b3f-4eaf-9bd1-132b766465a6 None None] [instance: 8518b46b-8053-41e4-9c1f-9b4215965ddc] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:28:56 user nova-compute[72863]: WARNING nova.compute.manager [req-e7d5cbe8-f9a4-4c52-881e-a1d4191f650b req-113e8424-85e1-4a3d-a349-b335d575b8f7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state building and task_state spawning.
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106136.2247536, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Resumed (Lifecycle Event)
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance spawned successfully.
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106136.2262206, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Started (Lifecycle Event)
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 15 13:28:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:56 user nova-compute[72863]: INFO nova.compute.manager [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Took 7.34 seconds to build instance.
Aug 15 13:28:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59e8be73-1abf-4d4b-9766-86d044746e2e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.446s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:28:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:28:58 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106123.5407693, 86c46771-bc19-4440-9ed1-d713a003b231 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:28:58 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Stopped (Lifecycle Event)
Aug 15 13:28:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2c9a2c9b-f7c8-4686-8673-3d8b6389d390 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:28:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2c9a2c9b-f7c8-4686-8673-3d8b6389d390 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:28:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:29:11 user nova-compute[72863]: INFO nova.compute.claims [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Claim successful on node user
Aug 15 13:29:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:29:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:29:12 user nova-compute[72863]: DEBUG nova.policy [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:29:12 user nova-compute[72863]: INFO nova.virt.block_device [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Booting with volume snapshot b0b8582b-ab4c-45ee-ae89-79a5e671fa48 at /dev/vda
Aug 15 13:29:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Successfully created port: 5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:13 user nova-compute[72863]: INFO nova.compute.manager [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Terminating instance
Aug 15 13:29:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-unplugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-unplugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e4be94a-5184-4891-a4e2-ba0e1a116d70 req-fc3e588b-058a-4842-a3ad-f47ed2edba51 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-unplugged-ccf2066c-f978-45c7-a691-ee40af7095cb for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:29:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Instance destroyed successfully.
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lazy-loading 'resources' on Instance uuid b3413aa3-879c-46a3-9495-24da1b2e28aa {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1955670837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1955670837',id=14,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPByr1GTrRN8wzd+UlWzWF75nggv0pluKOL64ZqvF0lKWAvjS17mmeEwa9N/vCzdLFc/6P2WkM1L3ljejVojtvnCVw3bl3i6AtHlFptlwTaNMW8Dz8zmF21o78tOYgxAQ==',key_name='tempest-keypair-1045534241',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7951b03c2da44b6bbb7c5f0746ddd02f',ramdisk_id='',reservation_id='r-sfub4rhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1751160429',owner_user_name='tempest-TaggedAttachmentsTest-1751160429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80f4012d293141f89e66f6ea556ca0da',uuid=b3413aa3-879c-46a3-9495-24da1b2e28aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converting VIF {"id": "ccf2066c-f978-45c7-a691-ee40af7095cb", "address": "fa:16:3e:47:68:49", "network": {"id": "025e5971-5b44-4b84-8831-0b34b82db00c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2079149251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7951b03c2da44b6bbb7c5f0746ddd02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2066c-f9", "ovs_interfaceid": "ccf2066c-f978-45c7-a691-ee40af7095cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG os_vif [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf2066c-f9, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:14 user nova-compute[72863]: INFO os_vif [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:68:49,bridge_name='br-int',has_traffic_filtering=True,id=ccf2066c-f978-45c7-a691-ee40af7095cb,network=Network(025e5971-5b44-4b84-8831-0b34b82db00c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2066c-f9')
Aug 15 13:29:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Deleting instance files /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa_del
Aug 15 13:29:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Deletion of /opt/stack/data/nova/instances/b3413aa3-879c-46a3-9495-24da1b2e28aa_del complete
Aug 15 13:29:14 user nova-compute[72863]: INFO nova.compute.manager [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Successfully updated port: 5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:29:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updating instance_info_cache with network_info: [{"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Instance network_info: |[{"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:15 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Took 1.30 seconds to deallocate network for instance.
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-c6c6d3ab-b817-41d7-8cb6-3dcc18d4c34f req-ad33d547-561f-41be-b00f-a254335ed43b service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-deleted-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:15 user nova-compute[72863]: INFO nova.compute.manager [req-c6c6d3ab-b817-41d7-8cb6-3dcc18d4c34f req-ad33d547-561f-41be-b00f-a254335ed43b service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Neutron deleted interface ccf2066c-f978-45c7-a691-ee40af7095cb; detaching it from the instance and deleting it from the info cache
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-c6c6d3ab-b817-41d7-8cb6-3dcc18d4c34f req-ad33d547-561f-41be-b00f-a254335ed43b service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-c6c6d3ab-b817-41d7-8cb6-3dcc18d4c34f req-ad33d547-561f-41be-b00f-a254335ed43b service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Detach interface failed, port_id=ccf2066c-f978-45c7-a691-ee40af7095cb, reason: Instance b3413aa3-879c-46a3-9495-24da1b2e28aa could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Acquiring lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] No waiting events found dispatching network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:16 user nova-compute[72863]: WARNING nova.compute.manager [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Received unexpected event network-vif-plugged-ccf2066c-f978-45c7-a691-ee40af7095cb for instance with vm_state deleted and task_state None.
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-changed-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Refreshing instance network info cache due to event network-changed-5263e4e8-751c-49e4-aff2-327b75064eb5. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Acquiring lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Acquired lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.network.neutron [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Refreshing network info cache for port 5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.195s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:29:16 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Deleted allocations for instance b3413aa3-879c-46a3-9495-24da1b2e28aa
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6e9743bd-9830-41cf-a21d-d4776c411549 tempest-TaggedAttachmentsTest-1751160429 tempest-TaggedAttachmentsTest-1751160429-project-member] Lock "b3413aa3-879c-46a3-9495-24da1b2e28aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Ignoring supplied device name: /dev/vdb
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.352s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:16 user nova-compute[72863]: INFO nova.compute.manager [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Attaching volume 16f95e17-51e7-4dd0-8e30-e3590cd85c8e to /dev/vdb
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9ceef-dbb4-4a73-a6b0-4f27aefa1fd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07519ed7-518c-4e4d-b6fb-4a6b3e721333]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbbf084-dd2a-4eaf-adce-ffdb018734c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7314efbb-9a66-41b7-911d-37ee7625a548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updated VIF entry in instance network info cache for port 5263e4e8-751c-49e4-aff2-327b75064eb5. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updating instance_info_cache with network_info: [{"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:17 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63fce1e-d4f3-41b3-9c32-e65f5964b63e]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updating existing volume attachment record: 89d789b2-19d5-40a4-9afe-3c1e100af681 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-67aabf92-a71e-4532-9891-432c7db2acab req-ab8f8998-a8a1-4030-ba4e-e330c33cb343 service nova] Releasing lock "refresh_cache-cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-changed-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Refreshing instance network info cache due to event network-changed-4ead8ee0-af24-4eaa-a260-05aa1970388e. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] Acquiring lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] Acquired lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Refreshing network info cache for port 4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.utils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad0432-fdc1-4d3f-a5cb-93881c49d21e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b26226-7b6e-404f-811a-ac7d2543e405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updated VIF entry in instance network info cache for port 4ead8ee0-af24-4eaa-a260-05aa1970388e. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updating instance_info_cache with network_info: [{"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e454cd0-a00a-4058-a3bc-0f4820f08cb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3145e533-b250-4c5f-a6ec-9a6d1a1a4a96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0f8851eb-d175-4891-a1f6-47fc0ede354e req-102a2ad7-bff8-4f02-bc61-aca3ceb82437 service nova] Releasing lock "refresh_cache-0ca9115a-03b2-48f5-b908-6d4f4247e7fe" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:18 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6497e30-d14f-4dea-8845-67e4623071cc]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG os_brick.utils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updating existing volume attachment record: b5452aef-f1b8-4362-8bce-279eba38623b {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7127MB free_disk=25.657203674316406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fcac4ae5-a862-496e-b30f-b4c73bcc3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:29:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Skipping network cache update for instance because it is Building. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [{"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrWPVEeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:26 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:26 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:26 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2143d-e8fa-40c8-9276-cd89451609e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:29:26 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da80072-186c-41d3-ab47-735998ddc7fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e] added
Aug 15 13:29:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60338464-a491-4ed4-b17a-6b19868a12e8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a0305d-5329-408f-88dd-bca19ed07f03]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrWPVEeX {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrWPVEeX" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390e7e2-0694-4c34-8f0c-98c984de483f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrWPVEeX'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf117b5-f27e-4db4-a83b-a6ca770d31b5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb42dc-9104-41a9-856b-1f681b9658f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:29:26 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:29:26 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:26 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:29:26 user nova-compute[72863]: 
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe80e27-0122-4f3e-9084-15a33c502cdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260]
Aug 15 13:29:26 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260] successful.
Aug 15 13:29:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b73de63-2d76-4f65-a582-f4ab116b55ec]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe37c1-2c9e-4f27-a2f0-edcb941c8e95]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca721861-774f-4d6c-8ca1-475c302c27a0]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrWPVEeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:29:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:29:27 user nova-compute[72863]: INFO nova.compute.claims [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Claim successful on node user
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26161616563646136', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161616563646136', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:29:27 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:29:27 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:29:27 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:29:27 user nova-compute[72863]:   <serial>16f95e17-51e7-4dd0-8e30-e3590cd85c8e</serial>
Aug 15 13:29:27 user nova-compute[72863]: </disk>
Aug 15 13:29:27 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:29:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Creating image(s)
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Ensure instance console log exists: /opt/stack/data/nova/instances/cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Start _get_guest_xml network_info=[{"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b5452aef-f1b8-4362-8bce-279eba38623b', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmJwoYyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c95b32d8-83b1-4265-b447-9faf06a23dad', 'serial': 'c95b32d8-83b1-4265-b447-9faf06a23dad'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:29:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmJwoYyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:27 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b692d4-cd46-4a28-9583-77e1cf2cf165]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:29:27 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72616c-f4b7-47b1-94c4-019f47cf7def]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad] added
Aug 15 13:29:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No VIF found with MAC fa:16:3e:5e:da:49, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac5a57b-13a9-41b0-8f7b-fec619321895]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27b6791-80ce-42a7-b16c-9737e7637a08]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmJwoYyZ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lmJwoYyZ" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d0f17-dd9b-405e-8cae-bcc9d4b7e196]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lmJwoYyZ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdcdc32-ab94-454f-a03a-3e10ed7145cb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f4f89-36a0-440d-b435-32fcbfe83eff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a3b2d23-24d0-4098-892f-e26342f82255 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.992s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:28 user nova-compute[72863]: INFO nova.virt.block_device [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Booting with volume-backed-image 40a3270d-656b-4d7d-8be8-25ab1ae5fd35 at /dev/vda
Aug 15 13:29:28 user nova-compute[72863]: DEBUG nova.policy [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f28612e758464797a56a4b7ea233ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e9e6721b634d2fb974f7a10c6e0359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888933a-12e7-4caa-967b-555f9226295a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260]
Aug 15 13:29:28 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260] successful.
Aug 15 13:29:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be7c10-7489-47fe-ad18-51a8b4761c26]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f580d7-7f1f-4f2c-9200-514c5c958153]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:28 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:28 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3597bc63-5954-4c53-96f9-29de42cb7a3b]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmJwoYyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:29:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Successfully created port: a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26438623035653539', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438623035653539', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-231707732',display_name='tempest-TestVolumeBootPattern-server-231707732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-231707732',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-tp4cctyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:13Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:29:29 user nova-compute[72863]:   <uuid>cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f</uuid>
Aug 15 13:29:29 user nova-compute[72863]:   <name>instance-00000017</name>
Aug 15 13:29:29 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:29:29 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:29:29 user nova-compute[72863]:   <metadata>
Aug 15 13:29:29 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:29:29 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:29:29 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-server-231707732</nova:name>
Aug 15 13:29:29 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:29:27</nova:creationTime>
Aug 15 13:29:29 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:29:29 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:29:29 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:29:29 user nova-compute[72863]:       <nova:owner>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:29:29 user nova-compute[72863]:       </nova:owner>
Aug 15 13:29:29 user nova-compute[72863]:       <nova:ports>
Aug 15 13:29:29 user nova-compute[72863]:         <nova:port uuid="5263e4e8-751c-49e4-aff2-327b75064eb5">
Aug 15 13:29:29 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 13:29:29 user nova-compute[72863]:         </nova:port>
Aug 15 13:29:29 user nova-compute[72863]:       </nova:ports>
Aug 15 13:29:29 user nova-compute[72863]:     </nova:instance>
Aug 15 13:29:29 user nova-compute[72863]:   </metadata>
Aug 15 13:29:29 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:29:29 user nova-compute[72863]:     <system>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="serial">cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f</entry>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="uuid">cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f</entry>
Aug 15 13:29:29 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:29:29 user nova-compute[72863]:     </system>
Aug 15 13:29:29 user nova-compute[72863]:   </sysinfo>
Aug 15 13:29:29 user nova-compute[72863]:   <os>
Aug 15 13:29:29 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:29:29 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:29:29 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:29:29 user nova-compute[72863]:   </os>
Aug 15 13:29:29 user nova-compute[72863]:   <features>
Aug 15 13:29:29 user nova-compute[72863]:     <acpi/>
Aug 15 13:29:29 user nova-compute[72863]:     <apic/>
Aug 15 13:29:29 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:29:29 user nova-compute[72863]:   </features>
Aug 15 13:29:29 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:29:29 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:29:29 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:29:29 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:29:29 user nova-compute[72863]:   </clock>
Aug 15 13:29:29 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:29:29 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:29:29 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:29:29 user nova-compute[72863]:   </cpu>
Aug 15 13:29:29 user nova-compute[72863]:   <devices>
Aug 15 13:29:29 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:29:29 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:29:29 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:29:29 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:29:29 user nova-compute[72863]:       <serial>c95b32d8-83b1-4265-b447-9faf06a23dad</serial>
Aug 15 13:29:29 user nova-compute[72863]:     </disk>
Aug 15 13:29:29 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:29:29 user nova-compute[72863]:       <mac address="fa:16:3e:c1:1c:f4"/>
Aug 15 13:29:29 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:29 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:29:29 user nova-compute[72863]:       <target dev="tap5263e4e8-75"/>
Aug 15 13:29:29 user nova-compute[72863]:     </interface>
Aug 15 13:29:29 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:29:29 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f/console.log" append="off"/>
Aug 15 13:29:29 user nova-compute[72863]:     </serial>
Aug 15 13:29:29 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:29:29 user nova-compute[72863]:     <video>
Aug 15 13:29:29 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:29 user nova-compute[72863]:     </video>
Aug 15 13:29:29 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:29:29 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:29:29 user nova-compute[72863]:     </rng>
Aug 15 13:29:29 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:29:29 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:29:29 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:29:29 user nova-compute[72863]:     </memballoon>
Aug 15 13:29:29 user nova-compute[72863]:   </devices>
Aug 15 13:29:29 user nova-compute[72863]: </domain>
Aug 15 13:29:29 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-231707732',display_name='tempest-TestVolumeBootPattern-server-231707732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-231707732',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-tp4cctyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:13Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG os_vif [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5263e4e8-75, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5263e4e8-75, col_values=(('external_ids', {'iface-id': '5263e4e8-751c-49e4-aff2-327b75064eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:1c:f4', 'vm-uuid': 'cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:29 user nova-compute[72863]: INFO os_vif [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75')
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:c1:1c:f4, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106154.498527, b3413aa3-879c-46a3-9495-24da1b2e28aa => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:29 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] VM Stopped (Lifecycle Event)
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b8cc5b4a-92ee-4f00-a6ee-a2fa9d5cc45a None None] [instance: b3413aa3-879c-46a3-9495-24da1b2e28aa] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Successfully updated port: a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-changed-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Refreshing instance network info cache due to event network-changed-a47a22fa-295c-43a5-aa09-1174db28999f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] Acquiring lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance network_info: |[{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] Acquired lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Refreshing network info cache for port a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updated VIF entry in instance network info cache for port a47a22fa-295c-43a5-aa09-1174db28999f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c47196e2-b789-4d64-8ff0-f6085f7e090c req-f08f1829-154c-40d1-9a83-c4f6327eb524 service nova] Releasing lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] No waiting events found dispatching network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:30 user nova-compute[72863]: WARNING nova.compute.manager [req-78ef9da5-3905-4c3b-97a5-852efaee6ecd req-583035d1-9f6c-4cb7-826d-9bd96f43e15f service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received unexpected event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 for instance with vm_state building and task_state spawning.
Aug 15 13:29:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:32 user nova-compute[72863]: INFO nova.compute.manager [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Terminating instance
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106172.8855853, cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] VM Resumed (Lifecycle Event)
Aug 15 13:29:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:29:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Instance spawned successfully.
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:32 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106172.8870296, cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] VM Started (Lifecycle Event)
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] No waiting events found dispatching network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:33 user nova-compute[72863]: WARNING nova.compute.manager [req-ca34cf90-7529-48e4-8910-6c4998fc4bfc req-27c6791b-061c-45e4-92eb-ce0f282c7762 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received unexpected event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 for instance with vm_state building and task_state spawning.
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-unplugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] No waiting events found dispatching network-vif-unplugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-dea61766-83f0-4f1b-ad9e-c3b304b97e9a req-18918c41-9d08-4bd9-ba75-992907b4b9d3 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-unplugged-50226385-bc9c-488b-9070-201b266392bf for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.compute.manager [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Took 21.25 seconds to build instance.
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f92405dc-1851-4163-8845-323828fe9857 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.336s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Instance destroyed successfully.
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lazy-loading 'resources' on Instance uuid fcac4ae5-a862-496e-b30f-b4c73bcc3368 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1704285328',display_name='tempest-VolumesAdminNegativeTest-server-1704285328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1704285328',id=6,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVehoWQp8Pgzot3PWmrpbJevnZ974U7ZlrUXA5FMu7mwu+wqXlTC8EWildq5eTUul4XBAYrei/b+rjEst2O5gnYgv3584X4KwuacGkP+2d3KrspH8xZBzr0BS9LYkUd+Q==',key_name='tempest-keypair-1093074584',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c077f561bb445aa9a3a35d2f677f0d0',ramdisk_id='',reservation_id='r-8bgkkzk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-890931694',owner_user_name='tempest-VolumesAdminNegativeTest-890931694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0de57a132def47359f74cad70c1b2a4f',uuid=fcac4ae5-a862-496e-b30f-b4c73bcc3368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converting VIF {"id": "50226385-bc9c-488b-9070-201b266392bf", "address": "fa:16:3e:6b:ca:51", "network": {"id": "91168eeb-1916-4953-893f-0a21641c6ef5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1927612243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c077f561bb445aa9a3a35d2f677f0d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50226385-bc", "ovs_interfaceid": "50226385-bc9c-488b-9070-201b266392bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG os_vif [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50226385-bc, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:29:33 user nova-compute[72863]: INFO os_vif [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:51,bridge_name='br-int',has_traffic_filtering=True,id=50226385-bc9c-488b-9070-201b266392bf,network=Network(91168eeb-1916-4953-893f-0a21641c6ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50226385-bc')
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Deleting instance files /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368_del
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Deletion of /opt/stack/data/nova/instances/fcac4ae5-a862-496e-b30f-b4c73bcc3368_del complete
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.compute.claims [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Claim successful on node user
Aug 15 13:29:33 user nova-compute[72863]: INFO nova.compute.manager [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 15 13:29:33 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:29:33 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:29:34 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.policy [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e68128a64baa4eb89f1454f94115ae1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f776a79a5746ae840d47da420daedc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:29:34 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Creating image(s)
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "/opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.217s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:34 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Took 1.15 seconds to deallocate network for instance.
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.229s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk 1073741824" returned: 0 in 0.054s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] Acquiring lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] No waiting events found dispatching network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:35 user nova-compute[72863]: WARNING nova.compute.manager [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received unexpected event network-vif-plugged-50226385-bc9c-488b-9070-201b266392bf for instance with vm_state deleted and task_state None.
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-ad46bc7e-fe33-4009-ba12-e4c4aa65376c req-0dd99f9b-3758-4dbe-9875-30e9ac4f5344 service nova] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Received event network-vif-deleted-50226385-bc9c-488b-9070-201b266392bf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Successfully created port: 35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Cannot resize image /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'migration_context' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Ensure instance console log exists: /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.667s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:35 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Deleted allocations for instance fcac4ae5-a862-496e-b30f-b4c73bcc3368
Aug 15 13:29:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-90679cb0-a222-4f65-8227-8364e04585b4 tempest-VolumesAdminNegativeTest-890931694 tempest-VolumesAdminNegativeTest-890931694-project-member] Lock "fcac4ae5-a862-496e-b30f-b4c73bcc3368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Successfully updated port: 35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquired lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-changed-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Refreshing instance network info cache due to event network-changed-35aeaef8-bfd4-4620-8b30-26d103f2510c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] Acquiring lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updating instance_info_cache with network_info: [{"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Releasing lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Instance network_info: |[{"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] Acquired lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.neutron [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Refreshing network info cache for port 35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Start _get_guest_xml network_info=[{"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:29:36 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:36 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451485257',display_name='tempest-AttachVolumeNegativeTest-server-451485257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451485257',id=25,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZb1/UiFRozb8uWgqS7HXBh5ZvXcQqjHqcn68tiATKmu/UVC7Sdq+AiaHAmiM0DdVgQd8Bfe9xKaJpP7ctqG4WkBMQj1VY2jixNCsANEhRRvJh9wEQPShxw25uahZKVQ==',key_name='tempest-keypair-1713708574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-eqxjzx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=deaee06a-0a48-45c7-b6d3-060b1778bf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'pci_devices' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:29:36 user nova-compute[72863]:   <uuid>deaee06a-0a48-45c7-b6d3-060b1778bf11</uuid>
Aug 15 13:29:36 user nova-compute[72863]:   <name>instance-00000019</name>
Aug 15 13:29:36 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:29:36 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:29:36 user nova-compute[72863]:   <metadata>
Aug 15 13:29:36 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:29:36 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeNegativeTest-server-451485257</nova:name>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:29:36</nova:creationTime>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:29:36 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:29:36 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:owner>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:user uuid="e68128a64baa4eb89f1454f94115ae1c">tempest-AttachVolumeNegativeTest-1688916020-project-member</nova:user>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:project uuid="67f776a79a5746ae840d47da420daedc">tempest-AttachVolumeNegativeTest-1688916020</nova:project>
Aug 15 13:29:36 user nova-compute[72863]:       </nova:owner>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:29:36 user nova-compute[72863]:       <nova:ports>
Aug 15 13:29:36 user nova-compute[72863]:         <nova:port uuid="35aeaef8-bfd4-4620-8b30-26d103f2510c">
Aug 15 13:29:36 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:29:36 user nova-compute[72863]:         </nova:port>
Aug 15 13:29:36 user nova-compute[72863]:       </nova:ports>
Aug 15 13:29:36 user nova-compute[72863]:     </nova:instance>
Aug 15 13:29:36 user nova-compute[72863]:   </metadata>
Aug 15 13:29:36 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:29:36 user nova-compute[72863]:     <system>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="serial">deaee06a-0a48-45c7-b6d3-060b1778bf11</entry>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="uuid">deaee06a-0a48-45c7-b6d3-060b1778bf11</entry>
Aug 15 13:29:36 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:29:36 user nova-compute[72863]:     </system>
Aug 15 13:29:36 user nova-compute[72863]:   </sysinfo>
Aug 15 13:29:36 user nova-compute[72863]:   <os>
Aug 15 13:29:36 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:29:36 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:29:36 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:29:36 user nova-compute[72863]:   </os>
Aug 15 13:29:36 user nova-compute[72863]:   <features>
Aug 15 13:29:36 user nova-compute[72863]:     <acpi/>
Aug 15 13:29:36 user nova-compute[72863]:     <apic/>
Aug 15 13:29:36 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:29:36 user nova-compute[72863]:   </features>
Aug 15 13:29:36 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:29:36 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:29:36 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:29:36 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:29:36 user nova-compute[72863]:   </clock>
Aug 15 13:29:36 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:29:36 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:29:36 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:29:36 user nova-compute[72863]:   </cpu>
Aug 15 13:29:36 user nova-compute[72863]:   <devices>
Aug 15 13:29:36 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:29:36 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:29:36 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk"/>
Aug 15 13:29:36 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:29:36 user nova-compute[72863]:     </disk>
Aug 15 13:29:36 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:29:36 user nova-compute[72863]:       <mac address="fa:16:3e:d9:98:15"/>
Aug 15 13:29:36 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:36 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:29:36 user nova-compute[72863]:       <target dev="tap35aeaef8-bf"/>
Aug 15 13:29:36 user nova-compute[72863]:     </interface>
Aug 15 13:29:36 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:29:36 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/console.log" append="off"/>
Aug 15 13:29:36 user nova-compute[72863]:     </serial>
Aug 15 13:29:36 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:29:36 user nova-compute[72863]:     <video>
Aug 15 13:29:36 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:36 user nova-compute[72863]:     </video>
Aug 15 13:29:36 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:29:36 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:29:36 user nova-compute[72863]:     </rng>
Aug 15 13:29:36 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:29:36 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:29:36 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:29:36 user nova-compute[72863]:     </memballoon>
Aug 15 13:29:36 user nova-compute[72863]:   </devices>
Aug 15 13:29:36 user nova-compute[72863]: </domain>
Aug 15 13:29:36 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451485257',display_name='tempest-AttachVolumeNegativeTest-server-451485257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451485257',id=25,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZb1/UiFRozb8uWgqS7HXBh5ZvXcQqjHqcn68tiATKmu/UVC7Sdq+AiaHAmiM0DdVgQd8Bfe9xKaJpP7ctqG4WkBMQj1VY2jixNCsANEhRRvJh9wEQPShxw25uahZKVQ==',key_name='tempest-keypair-1713708574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-eqxjzx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=deaee06a-0a48-45c7-b6d3-060b1778bf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG os_vif [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35aeaef8-bf, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35aeaef8-bf, col_values=(('external_ids', {'iface-id': '35aeaef8-bfd4-4620-8b30-26d103f2510c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:98:15', 'vm-uuid': 'deaee06a-0a48-45c7-b6d3-060b1778bf11'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:29:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:37 user nova-compute[72863]: INFO os_vif [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf')
Aug 15 13:29:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:29:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:d9:98:15, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:29:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updated VIF entry in instance network info cache for port 35aeaef8-bfd4-4620-8b30-26d103f2510c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:29:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updating instance_info_cache with network_info: [{"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:29:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-762057a5-4e2d-4d17-ad3d-88f31ba83dbf req-03944098-4e77-4c4f-9f5c-ab00d58ff045 service nova] Releasing lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.utils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80624b-b674-422e-beda-aed58ba0f313]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed33696-3976-4062-a7bc-dca0316e9b8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ce196-3b74-4eae-9476-4f3d933bfa3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc5a2b-7061-4608-a013-2ac56c3d28e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:29:38 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:29:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d61d960-1ced-4a94-aea8-73e73ddee576]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG os_brick.utils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:38 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating existing volume attachment record: 01a58873-817d-4ce1-8d19-ff952e8ae7f3 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] No waiting events found dispatching network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:39 user nova-compute[72863]: WARNING nova.compute.manager [req-c7138967-9823-45d0-9aea-f563dbd5f3af req-e06d3bd2-f792-4c4a-a6f7-028b1e0faff3 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received unexpected event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c for instance with vm_state building and task_state spawning.
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106180.8827212, deaee06a-0a48-45c7-b6d3-060b1778bf11 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] VM Resumed (Lifecycle Event)
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:29:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Instance spawned successfully.
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106180.885099, deaee06a-0a48-45c7-b6d3-060b1778bf11 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] VM Started (Lifecycle Event)
Aug 15 13:29:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:41 user nova-compute[72863]: INFO nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 15 13:29:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:41 user nova-compute[72863]: INFO nova.compute.manager [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Took 7.56 seconds to build instance.
Aug 15 13:29:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c05eda74-9eaf-47a0-b266-3bdca243247b tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.698s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] No waiting events found dispatching network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:41 user nova-compute[72863]: WARNING nova.compute.manager [req-ea12555f-c9a5-4936-b487-2a08f22b6ca3 req-b3798878-63a1-416a-a69f-6a3feaeda39c service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received unexpected event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c for instance with vm_state active and task_state None.
Aug 15 13:29:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:29:48 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Creating image(s)
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Ensure instance console log exists: /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start _get_guest_xml network_info=[{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '01a58873-817d-4ce1-8d19-ff952e8ae7f3', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'caf7e343-dda7-4247-be10-850b462cf0a9', 'serial': 'caf7e343-dda7-4247-be10-850b462cf0a9'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:29:48 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:48 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:29:48 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:48 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:29:48 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68caa019-3884-434d-b612-f1cdb20da55b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:29:48 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106173.5429304, fcac4ae5-a862-496e-b30f-b4c73bcc3368 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:48 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] VM Stopped (Lifecycle Event)
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f1749-0e94-4c21-bbee-e203432ee4b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9] added
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9659bac-474f-4b52-a4ee-4a8041d21493]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-61812e65-412f-471f-be53-492e8469e368 None None] [instance: fcac4ae5-a862-496e-b30f-b4c73bcc3368] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a543e-1209-4bd5-ba67-e24816641bf6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNDexcEr {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNDexcEr" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10cc56e-9a1b-48f3-a867-d7aff3618400]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNDexcEr'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a12ba-4dc2-46b2-bcb6-58ed937171d4]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7b5e6-9ff8-4097-84d0-e26a82815ecb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd3629-43fa-47a7-8fee-ceca5b05e894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260]
Aug 15 13:29:48 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260] successful.
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64450ae-deaa-40f0-abc5-3ee3b4169fb2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3823e99-1198-4920-b0c7-21b1bdb54529]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:29:48 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:29:48 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd5581-6936-4f11-a03d-b52f5aac6890]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:29:48 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23063663361366666', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063663361366666', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390587892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390587892',id=24,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-q8obhbh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:28Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:29:49 user nova-compute[72863]:   <uuid>5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</uuid>
Aug 15 13:29:49 user nova-compute[72863]:   <name>instance-00000018</name>
Aug 15 13:29:49 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:29:49 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:29:49 user nova-compute[72863]:   <metadata>
Aug 15 13:29:49 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:29:49 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1390587892</nova:name>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:29:48</nova:creationTime>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:29:49 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:29:49 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:owner>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:user uuid="f28612e758464797a56a4b7ea233ae66">tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member</nova:user>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:project uuid="03e9e6721b634d2fb974f7a10c6e0359">tempest-ServerBootFromVolumeStableRescueTest-603513238</nova:project>
Aug 15 13:29:49 user nova-compute[72863]:       </nova:owner>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:29:49 user nova-compute[72863]:       <nova:ports>
Aug 15 13:29:49 user nova-compute[72863]:         <nova:port uuid="a47a22fa-295c-43a5-aa09-1174db28999f">
Aug 15 13:29:49 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:29:49 user nova-compute[72863]:         </nova:port>
Aug 15 13:29:49 user nova-compute[72863]:       </nova:ports>
Aug 15 13:29:49 user nova-compute[72863]:     </nova:instance>
Aug 15 13:29:49 user nova-compute[72863]:   </metadata>
Aug 15 13:29:49 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:29:49 user nova-compute[72863]:     <system>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="serial">5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</entry>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="uuid">5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</entry>
Aug 15 13:29:49 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:29:49 user nova-compute[72863]:     </system>
Aug 15 13:29:49 user nova-compute[72863]:   </sysinfo>
Aug 15 13:29:49 user nova-compute[72863]:   <os>
Aug 15 13:29:49 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:29:49 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:29:49 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:29:49 user nova-compute[72863]:   </os>
Aug 15 13:29:49 user nova-compute[72863]:   <features>
Aug 15 13:29:49 user nova-compute[72863]:     <acpi/>
Aug 15 13:29:49 user nova-compute[72863]:     <apic/>
Aug 15 13:29:49 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:29:49 user nova-compute[72863]:   </features>
Aug 15 13:29:49 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:29:49 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:29:49 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:29:49 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:29:49 user nova-compute[72863]:   </clock>
Aug 15 13:29:49 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:29:49 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:29:49 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:29:49 user nova-compute[72863]:   </cpu>
Aug 15 13:29:49 user nova-compute[72863]:   <devices>
Aug 15 13:29:49 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:29:49 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:29:49 user nova-compute[72863]:       <source dev="/dev/sdd"/>
Aug 15 13:29:49 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:29:49 user nova-compute[72863]:       <serial>caf7e343-dda7-4247-be10-850b462cf0a9</serial>
Aug 15 13:29:49 user nova-compute[72863]:     </disk>
Aug 15 13:29:49 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:29:49 user nova-compute[72863]:       <mac address="fa:16:3e:91:1b:40"/>
Aug 15 13:29:49 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:49 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:29:49 user nova-compute[72863]:       <target dev="tapa47a22fa-29"/>
Aug 15 13:29:49 user nova-compute[72863]:     </interface>
Aug 15 13:29:49 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:29:49 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/console.log" append="off"/>
Aug 15 13:29:49 user nova-compute[72863]:     </serial>
Aug 15 13:29:49 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:29:49 user nova-compute[72863]:     <video>
Aug 15 13:29:49 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:29:49 user nova-compute[72863]:     </video>
Aug 15 13:29:49 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:29:49 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:29:49 user nova-compute[72863]:     </rng>
Aug 15 13:29:49 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:29:49 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:29:49 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:29:49 user nova-compute[72863]:     </memballoon>
Aug 15 13:29:49 user nova-compute[72863]:   </devices>
Aug 15 13:29:49 user nova-compute[72863]: </domain>
Aug 15 13:29:49 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390587892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390587892',id=24,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-q8obhbh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:28Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG os_vif [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa47a22fa-29, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa47a22fa-29, col_values=(('external_ids', {'iface-id': 'a47a22fa-295c-43a5-aa09-1174db28999f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:1b:40', 'vm-uuid': '5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:49 user nova-compute[72863]: INFO os_vif [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29')
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:29:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No VIF found with MAC fa:16:3e:91:1b:40, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:51 user nova-compute[72863]: WARNING nova.compute.manager [req-aee6a71c-f866-42c3-b52a-68af3be4c534 req-37632a48-36e7-4e61-9e02-70cf06d5871a service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state building and task_state spawning.
Aug 15 13:29:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106193.4867322, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Resumed (Lifecycle Event)
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance spawned successfully.
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106193.4910457, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Started (Lifecycle Event)
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:29:53 user nova-compute[72863]: WARNING nova.compute.manager [req-c9d0b95d-d567-4522-bbad-1d498da78c1e req-35606170-52d9-48a8-a617-574a2904d7ae service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state building and task_state spawning.
Aug 15 13:29:53 user nova-compute[72863]: INFO nova.compute.manager [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Took 26.40 seconds to build instance.
Aug 15 13:29:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7c69dbfc-52e2-4bae-bb6c-551f1c1abfa2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.515s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:29:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:29:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:08 user nova-compute[72863]: INFO nova.compute.manager [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Detaching volume 16f95e17-51e7-4dd0-8e30-e3590cd85c8e
Aug 15 13:30:08 user nova-compute[72863]: INFO nova.virt.block_device [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Attempting to driver detach volume 16f95e17-51e7-4dd0-8e30-e3590cd85c8e from mountpoint /dev/vdb
Aug 15 13:30:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Attempting to detach device vdb from instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:30:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:30:08 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:30:08 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:30:08 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:30:08 user nova-compute[72863]:   <serial>16f95e17-51e7-4dd0-8e30-e3590cd85c8e</serial>
Aug 15 13:30:08 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:30:08 user nova-compute[72863]: </disk>
Aug 15 13:30:08 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:30:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully detached device vdb from instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe from the persistent domain config.
Aug 15 13:30:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:30:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:30:08 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:30:08 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:30:08 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:30:08 user nova-compute[72863]:   <serial>16f95e17-51e7-4dd0-8e30-e3590cd85c8e</serial>
Aug 15 13:30:08 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:30:08 user nova-compute[72863]: </disk>
Aug 15 13:30:08 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106209.1665683, 0ca9115a-03b2-48f5-b908-6d4f4247e7fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:30:09 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully detached device vdb from instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe from the live domain config.
Aug 15 13:30:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrWPVEeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:30:09 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d7fe71-a4fd-4450-8147-d878b60dee77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21b58a-4ef6-4a41-b7f4-864e7591cea3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:30:09 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:09 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e (non-flash)
Aug 15 13:30:09 user nova-compute[72863]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:09 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c332dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6361e64-f65a-46e8-aa91-8786a76fb604]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e862161-4826-4a98-8c32-32da0588b9eb]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a3412-0bef-414d-a6c2-3c10dbd387fd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f26fd59-4647-4c52-9043-b4ffc4fa904f]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1637e228-e39b-449b-b906-8a3518fedb51]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acdf551-f3f0-4dc3-9cb4-9766f6571a8e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260]
Aug 15 13:30:09 user nova-compute[72863]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e, portal: 172.16.0.220,3260] successful.
Aug 15 13:30:09 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510ba77-e7ac-4eb6-a547-2c21d8fb708c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== disconnect_volume: return (276ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd9d823b-e180-4da1-b5b5-931dc2973e31 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.648s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:10 user nova-compute[72863]: INFO nova.compute.manager [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Terminating instance
Aug 15 13:30:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-unplugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] No waiting events found dispatching network-vif-unplugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-36e6e88c-d883-4ffc-9204-dd52f91613ce req-e343f9c1-0001-4ab5-aebd-c3701a942802 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-unplugged-4ead8ee0-af24-4eaa-a260-05aa1970388e for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:30:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Instance destroyed successfully.
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'resources' on Instance uuid 0ca9115a-03b2-48f5-b908-6d4f4247e7fe {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1385141772',display_name='tempest-VolumesSnapshotTestJSON-instance-1385141772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1385141772',id=18,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPUiCuMAUh6sgpwcN51e1nGLu/6VDZcEKShGIBpvPBqZQFESnoX8mj2ylP7Cfac3e1UfYhotEiPeOuefZbPyPER/Ur4se0Lj3vBMPssYNT3k+PZ4NtVVhs05wvt5DHGvA==',key_name='tempest-keypair-1698194092',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-0781rc1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=0ca9115a-03b2-48f5-b908-6d4f4247e7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "address": "fa:16:3e:5e:da:49", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ead8ee0-af", "ovs_interfaceid": "4ead8ee0-af24-4eaa-a260-05aa1970388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_vif [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ead8ee0-af, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:11 user nova-compute[72863]: INFO os_vif [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:da:49,bridge_name='br-int',has_traffic_filtering=True,id=4ead8ee0-af24-4eaa-a260-05aa1970388e,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ead8ee0-af')
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrWPVEeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:30:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f95e17-51e7-4dd0-8e30-e3590cd85c8e', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5f2f3f-a700-40f0-b34a-20513023d22b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[106f73bd-8198-4372-8e98-c07f365b5580]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:11 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:11 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c330430>, {}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Disconnecting from: [] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== disconnect_volume: return (59ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:30:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Deleting instance files /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe_del
Aug 15 13:30:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Deletion of /opt/stack/data/nova/instances/0ca9115a-03b2-48f5-b908-6d4f4247e7fe_del complete
Aug 15 13:30:11 user nova-compute[72863]: INFO nova.compute.manager [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 13:30:11 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:30:11 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:12 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Took 0.92 seconds to deallocate network for instance.
Aug 15 13:30:12 user nova-compute[72863]: WARNING nova.volume.cinder [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Attachment 89d789b2-19d5-40a4-9afe-3c1e100af681 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 89d789b2-19d5-40a4-9afe-3c1e100af681. (HTTP 404) (Request-ID: req-ff71a61d-424c-4e20-a6ca-6c3fc17cdbbf)
Aug 15 13:30:12 user nova-compute[72863]: INFO nova.compute.manager [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:12 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Deleted allocations for instance 0ca9115a-03b2-48f5-b908-6d4f4247e7fe
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] Acquiring lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] No waiting events found dispatching network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:12 user nova-compute[72863]: WARNING nova.compute.manager [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received unexpected event network-vif-plugged-4ead8ee0-af24-4eaa-a260-05aa1970388e for instance with vm_state deleted and task_state None.
Aug 15 13:30:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-92973c8c-8fa1-4711-a818-91aaacc4193e req-1bf6dc6d-aa78-48fc-ad2a-0cccc88d2f48 service nova] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Received event network-vif-deleted-4ead8ee0-af24-4eaa-a260-05aa1970388e {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a62ed0fc-75e8-4b44-a534-d2fd5275e90a tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "0ca9115a-03b2-48f5-b908-6d4f4247e7fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:19 user nova-compute[72863]: INFO nova.compute.manager [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Rescuing
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:20 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:20 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7048MB free_disk=25.669677734375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance deaee06a-0a48-45c7-b6d3-060b1778bf11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:20 user nova-compute[72863]: WARNING nova.compute.manager [req-42eba68f-4aca-4d60-b120-e08e6e6be523 req-9fb86497-7337-446c-a81d-59b6bce82e70 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state active and task_state rescuing.
Aug 15 13:30:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance destroyed successfully.
Aug 15 13:30:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Attempting rescue
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72863) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:30:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Creating image(s)
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue" returned: 0 in 0.056s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start _get_guest_xml network_info=[{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:bb:5c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1773750799',display_name='tempest-ServerRescueNegativeTestJSON-server-1773750799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1773750799',id=20,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-uwt2f1bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:40Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=9fdc0841-80ef-48d8-83bc-db09fa20144e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:bb:5c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:bb:5c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:21 user nova-compute[72863]:   <uuid>9fdc0841-80ef-48d8-83bc-db09fa20144e</uuid>
Aug 15 13:30:21 user nova-compute[72863]:   <name>instance-00000014</name>
Aug 15 13:30:21 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:21 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:21 user nova-compute[72863]:   <metadata>
Aug 15 13:30:21 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:21 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1773750799</nova:name>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:21</nova:creationTime>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:21 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:21 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:30:21 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:30:21 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:21 user nova-compute[72863]:         <nova:port uuid="06aadf08-917e-498a-80a8-2428643011e1">
Aug 15 13:30:21 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 13:30:21 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:21 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:21 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:21 user nova-compute[72863]:   </metadata>
Aug 15 13:30:21 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:21 user nova-compute[72863]:     <system>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="serial">9fdc0841-80ef-48d8-83bc-db09fa20144e</entry>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="uuid">9fdc0841-80ef-48d8-83bc-db09fa20144e</entry>
Aug 15 13:30:21 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:21 user nova-compute[72863]:     </system>
Aug 15 13:30:21 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:21 user nova-compute[72863]:   <os>
Aug 15 13:30:21 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:21 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:21 user nova-compute[72863]:   </os>
Aug 15 13:30:21 user nova-compute[72863]:   <features>
Aug 15 13:30:21 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:21 user nova-compute[72863]:     <apic/>
Aug 15 13:30:21 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:21 user nova-compute[72863]:   </features>
Aug 15 13:30:21 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:21 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:21 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:21 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:21 user nova-compute[72863]:   </clock>
Aug 15 13:30:21 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:21 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:21 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:21 user nova-compute[72863]:   </cpu>
Aug 15 13:30:21 user nova-compute[72863]:   <devices>
Aug 15 13:30:21 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:21 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:21 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue"/>
Aug 15 13:30:21 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:21 user nova-compute[72863]:     </disk>
Aug 15 13:30:21 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:21 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:21 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk"/>
Aug 15 13:30:21 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:30:21 user nova-compute[72863]:     </disk>
Aug 15 13:30:21 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:21 user nova-compute[72863]:       <mac address="fa:16:3e:bb:5c:75"/>
Aug 15 13:30:21 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:21 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:21 user nova-compute[72863]:       <target dev="tap06aadf08-91"/>
Aug 15 13:30:21 user nova-compute[72863]:     </interface>
Aug 15 13:30:21 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:21 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/console.log" append="off"/>
Aug 15 13:30:21 user nova-compute[72863]:     </serial>
Aug 15 13:30:21 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:21 user nova-compute[72863]:     <video>
Aug 15 13:30:21 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:21 user nova-compute[72863]:     </video>
Aug 15 13:30:21 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:21 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:21 user nova-compute[72863]:     </rng>
Aug 15 13:30:21 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:21 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:21 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:21 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:21 user nova-compute[72863]:   </devices>
Aug 15 13:30:21 user nova-compute[72863]: </domain>
Aug 15 13:30:21 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance destroyed successfully.
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:bb:5c:75, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:23 user nova-compute[72863]: WARNING nova.compute.manager [req-c7ffb38f-3721-4fc3-a5a3-2849a6498f6d req-cf04770c-5077-41f4-9f19-39f526028474 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state active and task_state rescuing.
Aug 15 13:30:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:25 user nova-compute[72863]: WARNING nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state active and task_state rescuing.
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:25 user nova-compute[72863]: WARNING nova.compute.manager [req-f2abcfc3-d186-4c31-a18a-6ceb44c85970 req-06291dbf-1f54-48fa-979c-7f86351e0ee3 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state active and task_state rescuing.
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.compute.claims [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Claim successful on node user
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for 9fdc0841-80ef-48d8-83bc-db09fa20144e due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106225.4543414, 9fdc0841-80ef-48d8-83bc-db09fa20144e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] VM Resumed (Lifecycle Event)
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-29aae9a5-0e64-4ca0-99f7-053d51e34c3e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106225.454645, 9fdc0841-80ef-48d8-83bc-db09fa20144e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] VM Started (Lifecycle Event)
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.policy [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd885a5f78b6e4c3c993fee958bee7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8a87964e7845cba898b18f2d5021ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:30:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Creating image(s)
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106211.132205, 0ca9115a-03b2-48f5-b908-6d4f4247e7fe => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:26 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] VM Stopped (Lifecycle Event)
Aug 15 13:30:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ba2ab5e1-4548-40d5-9d9d-3c7f16d3fec5 None None] [instance: 0ca9115a-03b2-48f5-b908-6d4f4247e7fe] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk 1073741824" returned: 0 in 0.050s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Cannot resize image /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'migration_context' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Ensure instance console log exists: /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Successfully created port: 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:30:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Successfully updated port: 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-changed-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Refreshing instance network info cache due to event network-changed-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] Acquiring lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating instance_info_cache with network_info: [{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance network_info: |[{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] Acquired lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.neutron [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Refreshing network info cache for port 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start _get_guest_xml network_info=[{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-tempest.common.compute-instance-1730135285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_devices' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:28 user nova-compute[72863]:   <uuid>246b401a-83c6-40d0-8f30-95af5cbebc35</uuid>
Aug 15 13:30:28 user nova-compute[72863]:   <name>instance-0000001a</name>
Aug 15 13:30:28 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:28 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:28 user nova-compute[72863]:   <metadata>
Aug 15 13:30:28 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:28 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:name>tempest-tempest.common.compute-instance-1730135285</nova:name>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:28</nova:creationTime>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:28 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:28 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:user uuid="d885a5f78b6e4c3c993fee958bee7cd0">tempest-ServerActionsTestOtherA-278685911-project-member</nova:user>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:project uuid="2d8a87964e7845cba898b18f2d5021ec">tempest-ServerActionsTestOtherA-278685911</nova:project>
Aug 15 13:30:28 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:30:28 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:28 user nova-compute[72863]:         <nova:port uuid="1ec0c786-08d0-44f6-8c5d-4e4fb3665d79">
Aug 15 13:30:28 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:30:28 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:28 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:28 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:28 user nova-compute[72863]:   </metadata>
Aug 15 13:30:28 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:28 user nova-compute[72863]:     <system>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="serial">246b401a-83c6-40d0-8f30-95af5cbebc35</entry>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="uuid">246b401a-83c6-40d0-8f30-95af5cbebc35</entry>
Aug 15 13:30:28 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:28 user nova-compute[72863]:     </system>
Aug 15 13:30:28 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:28 user nova-compute[72863]:   <os>
Aug 15 13:30:28 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:28 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:30:28 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:28 user nova-compute[72863]:   </os>
Aug 15 13:30:28 user nova-compute[72863]:   <features>
Aug 15 13:30:28 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:28 user nova-compute[72863]:     <apic/>
Aug 15 13:30:28 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:28 user nova-compute[72863]:   </features>
Aug 15 13:30:28 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:28 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:28 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:28 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:28 user nova-compute[72863]:   </clock>
Aug 15 13:30:28 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:28 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:28 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:28 user nova-compute[72863]:   </cpu>
Aug 15 13:30:28 user nova-compute[72863]:   <devices>
Aug 15 13:30:28 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:28 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:28 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk"/>
Aug 15 13:30:28 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:28 user nova-compute[72863]:     </disk>
Aug 15 13:30:28 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:28 user nova-compute[72863]:       <mac address="fa:16:3e:ce:b8:7e"/>
Aug 15 13:30:28 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:28 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:28 user nova-compute[72863]:       <target dev="tap1ec0c786-08"/>
Aug 15 13:30:28 user nova-compute[72863]:     </interface>
Aug 15 13:30:28 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:28 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/console.log" append="off"/>
Aug 15 13:30:28 user nova-compute[72863]:     </serial>
Aug 15 13:30:28 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:28 user nova-compute[72863]:     <video>
Aug 15 13:30:28 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:28 user nova-compute[72863]:     </video>
Aug 15 13:30:28 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:28 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:28 user nova-compute[72863]:     </rng>
Aug 15 13:30:28 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:28 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:28 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:28 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:28 user nova-compute[72863]:   </devices>
Aug 15 13:30:28 user nova-compute[72863]: </domain>
Aug 15 13:30:28 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-tempest.common.compute-instance-1730135285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG os_vif [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec0c786-08, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec0c786-08, col_values=(('external_ids', {'iface-id': '1ec0c786-08d0-44f6-8c5d-4e4fb3665d79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:b8:7e', 'vm-uuid': '246b401a-83c6-40d0-8f30-95af5cbebc35'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:28 user nova-compute[72863]: INFO os_vif [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08')
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:ce:b8:7e, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:30:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updated VIF entry in instance network info cache for port 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:30:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating instance_info_cache with network_info: [{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1ffd5878-71fb-4f06-a127-57b23353e78c req-3d93d952-bf23-42f8-a04f-5873b2ac21f6 service nova] Releasing lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "36996814-2797-4261-80dd-59171815aef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:30:30 user nova-compute[72863]: INFO nova.compute.claims [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Claim successful on node user
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:30 user nova-compute[72863]: WARNING nova.compute.manager [req-f126ab0a-6e62-4ca7-8d12-cc2a2174c747 req-c76b627b-2cd7-443f-af10-cc330e61bc40 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state building and task_state spawning.
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:30:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:30:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Creating image(s)
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "/opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "/opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "/opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG nova.policy [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fed10e3f5c747719e8894168cdc5546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baba30e66ae4f9bad5a891c97ac4650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk 1073741824" returned: 0 in 0.056s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.215s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Cannot resize image /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'migration_context' on Instance uuid 36996814-2797-4261-80dd-59171815aef0 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Ensure instance console log exists: /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106232.6855414, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Resumed (Lifecycle Event)
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance spawned successfully.
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106232.692732, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Started (Lifecycle Event)
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:32 user nova-compute[72863]: INFO nova.compute.manager [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Took 7.90 seconds to build instance.
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:32 user nova-compute[72863]: WARNING nova.compute.manager [req-219aad2f-58c5-4eaa-a1e8-c77c3e954a3c req-9b8ce45a-dbd9-49be-b250-23b7a4b8e0b0 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state None.
Aug 15 13:30:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1d33a982-9347-44c4-87f7-232111c3da91 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.033s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Successfully created port: ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquired lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'info_cache' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Successfully updated port: ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquired lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Updating instance_info_cache with network_info: [{"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Releasing lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Instance network_info: |[{"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Start _get_guest_xml network_info=[{"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-251689554',display_name='tempest-ServersNegativeTestJSON-server-251689554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-251689554',id=27,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-9wgjc30c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:31Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=36996814-2797-4261-80dd-59171815aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'pci_devices' on Instance uuid 36996814-2797-4261-80dd-59171815aef0 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:34 user nova-compute[72863]:   <uuid>36996814-2797-4261-80dd-59171815aef0</uuid>
Aug 15 13:30:34 user nova-compute[72863]:   <name>instance-0000001b</name>
Aug 15 13:30:34 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:34 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:34 user nova-compute[72863]:   <metadata>
Aug 15 13:30:34 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:34 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:name>tempest-ServersNegativeTestJSON-server-251689554</nova:name>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:34</nova:creationTime>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:34 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:34 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:user uuid="9fed10e3f5c747719e8894168cdc5546">tempest-ServersNegativeTestJSON-2047494063-project-member</nova:user>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:project uuid="3baba30e66ae4f9bad5a891c97ac4650">tempest-ServersNegativeTestJSON-2047494063</nova:project>
Aug 15 13:30:34 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:30:34 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:34 user nova-compute[72863]:         <nova:port uuid="ba3a589c-323e-4b17-8919-49eef41fc511">
Aug 15 13:30:34 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:30:34 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:34 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:34 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:34 user nova-compute[72863]:   </metadata>
Aug 15 13:30:34 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:34 user nova-compute[72863]:     <system>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="serial">36996814-2797-4261-80dd-59171815aef0</entry>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="uuid">36996814-2797-4261-80dd-59171815aef0</entry>
Aug 15 13:30:34 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:34 user nova-compute[72863]:     </system>
Aug 15 13:30:34 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:34 user nova-compute[72863]:   <os>
Aug 15 13:30:34 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:34 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:30:34 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:34 user nova-compute[72863]:   </os>
Aug 15 13:30:34 user nova-compute[72863]:   <features>
Aug 15 13:30:34 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:34 user nova-compute[72863]:     <apic/>
Aug 15 13:30:34 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:34 user nova-compute[72863]:   </features>
Aug 15 13:30:34 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:34 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:34 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:34 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:34 user nova-compute[72863]:   </clock>
Aug 15 13:30:34 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:34 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:34 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:34 user nova-compute[72863]:   </cpu>
Aug 15 13:30:34 user nova-compute[72863]:   <devices>
Aug 15 13:30:34 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:34 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:34 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk"/>
Aug 15 13:30:34 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:34 user nova-compute[72863]:     </disk>
Aug 15 13:30:34 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:34 user nova-compute[72863]:       <mac address="fa:16:3e:7d:39:0e"/>
Aug 15 13:30:34 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:34 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:34 user nova-compute[72863]:       <target dev="tapba3a589c-32"/>
Aug 15 13:30:34 user nova-compute[72863]:     </interface>
Aug 15 13:30:34 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:34 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/console.log" append="off"/>
Aug 15 13:30:34 user nova-compute[72863]:     </serial>
Aug 15 13:30:34 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:34 user nova-compute[72863]:     <video>
Aug 15 13:30:34 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:34 user nova-compute[72863]:     </video>
Aug 15 13:30:34 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:34 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:34 user nova-compute[72863]:     </rng>
Aug 15 13:30:34 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:34 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:34 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:34 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:34 user nova-compute[72863]:   </devices>
Aug 15 13:30:34 user nova-compute[72863]: </domain>
Aug 15 13:30:34 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-251689554',display_name='tempest-ServersNegativeTestJSON-server-251689554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-251689554',id=27,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-9wgjc30c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:31Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=36996814-2797-4261-80dd-59171815aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG os_vif [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba3a589c-32, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba3a589c-32, col_values=(('external_ids', {'iface-id': 'ba3a589c-323e-4b17-8919-49eef41fc511', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:39:0e', 'vm-uuid': '36996814-2797-4261-80dd-59171815aef0'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: INFO os_vif [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32')
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] No VIF found with MAC fa:16:3e:7d:39:0e, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Releasing lock "refresh_cache-86c46771-bc19-4440-9ed1-d713a003b231" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:34 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance destroyed successfully.
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'resources' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG os_vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b260b4c-be, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:34 user nova-compute[72863]: INFO os_vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start _get_guest_xml network_info=[{"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'numa_topology' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-changed-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Refreshing instance network info cache due to event network-changed-ba3a589c-323e-4b17-8919-49eef41fc511. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] Acquiring lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] Acquired lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Refreshing network info cache for port ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:35 user nova-compute[72863]:   <uuid>86c46771-bc19-4440-9ed1-d713a003b231</uuid>
Aug 15 13:30:35 user nova-compute[72863]:   <name>instance-00000004</name>
Aug 15 13:30:35 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:35 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:35 user nova-compute[72863]:   <metadata>
Aug 15 13:30:35 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:35 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeTestJSON-server-1730461208</nova:name>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:34</nova:creationTime>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:35 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:35 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:user uuid="acc0646305654477852de0c8bdebce90">tempest-AttachVolumeTestJSON-1527183200-project-member</nova:user>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:project uuid="974e84d7fd49440bb0449944cc4ffa94">tempest-AttachVolumeTestJSON-1527183200</nova:project>
Aug 15 13:30:35 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:30:35 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:35 user nova-compute[72863]:         <nova:port uuid="2b260b4c-bea8-4b7d-9131-0a938ed031e6">
Aug 15 13:30:35 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:30:35 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:35 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:35 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:35 user nova-compute[72863]:   </metadata>
Aug 15 13:30:35 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:35 user nova-compute[72863]:     <system>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="serial">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="uuid">86c46771-bc19-4440-9ed1-d713a003b231</entry>
Aug 15 13:30:35 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:35 user nova-compute[72863]:     </system>
Aug 15 13:30:35 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:35 user nova-compute[72863]:   <os>
Aug 15 13:30:35 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:35 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:30:35 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:35 user nova-compute[72863]:   </os>
Aug 15 13:30:35 user nova-compute[72863]:   <features>
Aug 15 13:30:35 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:35 user nova-compute[72863]:     <apic/>
Aug 15 13:30:35 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:35 user nova-compute[72863]:   </features>
Aug 15 13:30:35 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:35 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:35 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:35 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:35 user nova-compute[72863]:   </clock>
Aug 15 13:30:35 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:35 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:35 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:35 user nova-compute[72863]:   </cpu>
Aug 15 13:30:35 user nova-compute[72863]:   <devices>
Aug 15 13:30:35 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:35 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:35 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk"/>
Aug 15 13:30:35 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:35 user nova-compute[72863]:     </disk>
Aug 15 13:30:35 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:35 user nova-compute[72863]:       <mac address="fa:16:3e:03:ed:b5"/>
Aug 15 13:30:35 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:35 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:35 user nova-compute[72863]:       <target dev="tap2b260b4c-be"/>
Aug 15 13:30:35 user nova-compute[72863]:     </interface>
Aug 15 13:30:35 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:35 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/console.log" append="off"/>
Aug 15 13:30:35 user nova-compute[72863]:     </serial>
Aug 15 13:30:35 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:35 user nova-compute[72863]:     <video>
Aug 15 13:30:35 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:35 user nova-compute[72863]:     </video>
Aug 15 13:30:35 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:35 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:35 user nova-compute[72863]:     </rng>
Aug 15 13:30:35 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:35 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:35 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:35 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:35 user nova-compute[72863]:   </devices>
Aug 15 13:30:35 user nova-compute[72863]: </domain>
Aug 15 13:30:35 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.225s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Updated VIF entry in instance network info cache for port ba3a589c-323e-4b17-8919-49eef41fc511. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Updating instance_info_cache with network_info: [{"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-743c1057-a18a-4429-9626-82d54a008103 req-ae7db375-adbc-44fe-a3e2-a46316a289fc service nova] Releasing lock "refresh_cache-36996814-2797-4261-80dd-59171815aef0" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Cannot resize image /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'migration_context' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG os_vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b260b4c-be, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b260b4c-be, col_values=(('external_ids', {'iface-id': '2b260b4c-bea8-4b7d-9131-0a938ed031e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ed:b5', 'vm-uuid': '86c46771-bc19-4440-9ed1-d713a003b231'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: INFO os_vif [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Acquiring lock "36996814-2797-4261-80dd-59171815aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] No waiting events found dispatching network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:37 user nova-compute[72863]: WARNING nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received unexpected event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 for instance with vm_state building and task_state spawning.
Aug 15 13:30:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Acquiring lock "36996814-2797-4261-80dd-59171815aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] No waiting events found dispatching network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:37 user nova-compute[72863]: WARNING nova.compute.manager [req-ae8b78af-79ce-45f6-a0a1-6bc018a34f82 req-78fecba9-464f-4299-9624-52fbf80b7e73 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received unexpected event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 for instance with vm_state building and task_state spawning.
Aug 15 13:30:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:38 user nova-compute[72863]: WARNING nova.compute.manager [req-32054f72-cf94-47ac-b884-79395f6b4154 req-db7ade23-ace7-46c2-b4b5-8208c4cacd8c service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state powering-on.
Aug 15 13:30:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106239.874739, 36996814-2797-4261-80dd-59171815aef0 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] VM Resumed (Lifecycle Event)
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:39 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 36996814-2797-4261-80dd-59171815aef0] Instance spawned successfully.
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106239.8766582, 36996814-2797-4261-80dd-59171815aef0 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:39 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] VM Started (Lifecycle Event)
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Took 8.58 seconds to spawn the instance on the hypervisor.
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Took 9.53 seconds to build instance.
Aug 15 13:30:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c6646af0-b8b4-4e8f-96c4-3e79e3ffd186 tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.628s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106240.4218543, 86c46771-bc19-4440-9ed1-d713a003b231 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Resumed (Lifecycle Event)
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:40 user nova-compute[72863]: WARNING nova.compute.manager [req-334638cd-0f38-42b3-86cb-29bbc4719c6a req-8786d53a-13ac-43d8-a1cc-d46c849fef1e service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state stopped and task_state powering-on.
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance rebooted successfully.
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1cce423-91a9-4ca6-9573-41160ccb868f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106240.4270835, 86c46771-bc19-4440-9ed1-d713a003b231 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Started (Lifecycle Event)
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 13:30:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-changed-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Refreshing instance network info cache due to event network-changed-a249e220-f1eb-4dee-9aaf-f12953a48bbd. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG nova.network.neutron [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Refreshing network info cache for port a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG nova.network.neutron [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updated VIF entry in instance network info cache for port a249e220-f1eb-4dee-9aaf-f12953a48bbd. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG nova.network.neutron [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0214ce40-d280-4954-a6e2-a218e318ce4b req-07c26299-474e-4cc4-b492-c5b7f3e604e4 service nova] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:42 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:30:42 user nova-compute[72863]: INFO nova.compute.claims [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Claim successful on node user
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:30:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:30:43 user nova-compute[72863]: INFO nova.virt.block_device [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Booting with volume 02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c at /dev/vda
Aug 15 13:30:43 user nova-compute[72863]: DEBUG nova.policy [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b3145c37cde4968bafdb06a74599170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48481eca81a74f65b273919037f1677c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG os_brick.utils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b82cd4-d33c-41c8-af6a-68ad39ee8852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ada955-2bd2-4ac0-9460-bedf4981c361]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc1178-b1d3-4b3a-9244-bc0db13341b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2e27a-8fc2-4cd6-8608-769ce241cbfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:30:44 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:30:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb64eb6-f9fd-4dbe-b554-b3d6ba4466d8]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG os_brick.utils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating existing volume attachment record: 5f085431-4f90-485a-bd83-d78620f3340c {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Successfully created port: 99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:30:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Successfully updated port: 99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquired lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-changed-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Refreshing instance network info cache due to event network-changed-99f3c102-8d72-48ae-a59a-8bea7f581c01. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] Acquiring lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating instance_info_cache with network_info: [{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Releasing lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance network_info: |[{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] Acquired lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Refreshing network info cache for port 99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:30:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updated VIF entry in instance network info cache for port 99f3c102-8d72-48ae-a59a-8bea7f581c01. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:30:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating instance_info_cache with network_info: [{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb1180bd-4593-47d1-86ee-e6754ff09640 req-dc7b8748-b849-41b0-b26e-1f759d21a94a service nova] Releasing lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:48 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:30:48 user nova-compute[72863]: INFO nova.compute.claims [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Claim successful on node user
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:30:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.policy [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f6d22cd35c54349868cd6ecacc7340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffea36ec1e34d8fa6c4c9c66fc4a8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:30:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Creating image(s)
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk 1073741824" returned: 0 in 0.073s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Successfully created port: f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Cannot resize image /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'migration_context' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:50 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Successfully updated port: f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-changed-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing instance network info cache due to event network-changed-f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance network_info: |[{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing network info cache for port f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start _get_guest_xml network_info=[{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:51 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:51 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-545359356',display_name='tempest-ServerStableDeviceRescueTest-server-545359356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-545359356',id=29,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlwyH2myAPySn5x6PNkp2gpy5J2NL3Uyat6gEr8HGloj1v2tnIcad8iCfPcZCFitHnYRkj35+HXQO7njTkU3ciMsVD7GnbEiuyJMA/SjXMCmdM57pZro2H9qLP7LLvojA==',key_name='tempest-keypair-858193593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffea36ec1e34d8fa6c4c9c66fc4a8da',ramdisk_id='',reservation_id='r-wnc2l5je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1470876027',owner_user_name='tempest-ServerStableDeviceRescueTest-1470876027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6d22cd35c54349868cd6ecacc7340c',uuid=f6b53ea3-4cde-4488-b15e-52d522ac557e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converting VIF {"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:51 user nova-compute[72863]:   <uuid>f6b53ea3-4cde-4488-b15e-52d522ac557e</uuid>
Aug 15 13:30:51 user nova-compute[72863]:   <name>instance-0000001d</name>
Aug 15 13:30:51 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:51 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:51 user nova-compute[72863]:   <metadata>
Aug 15 13:30:51 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:51 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-545359356</nova:name>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:51</nova:creationTime>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:51 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:51 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:user uuid="5f6d22cd35c54349868cd6ecacc7340c">tempest-ServerStableDeviceRescueTest-1470876027-project-member</nova:user>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:project uuid="bffea36ec1e34d8fa6c4c9c66fc4a8da">tempest-ServerStableDeviceRescueTest-1470876027</nova:project>
Aug 15 13:30:51 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:30:51 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:51 user nova-compute[72863]:         <nova:port uuid="f33b5663-b6a2-42b9-a763-22743af05207">
Aug 15 13:30:51 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 13:30:51 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:51 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:51 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:51 user nova-compute[72863]:   </metadata>
Aug 15 13:30:51 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:51 user nova-compute[72863]:     <system>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="serial">f6b53ea3-4cde-4488-b15e-52d522ac557e</entry>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="uuid">f6b53ea3-4cde-4488-b15e-52d522ac557e</entry>
Aug 15 13:30:51 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:51 user nova-compute[72863]:     </system>
Aug 15 13:30:51 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:51 user nova-compute[72863]:   <os>
Aug 15 13:30:51 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:51 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:30:51 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:51 user nova-compute[72863]:   </os>
Aug 15 13:30:51 user nova-compute[72863]:   <features>
Aug 15 13:30:51 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:51 user nova-compute[72863]:     <apic/>
Aug 15 13:30:51 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:51 user nova-compute[72863]:   </features>
Aug 15 13:30:51 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:51 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:51 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:51 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:51 user nova-compute[72863]:   </clock>
Aug 15 13:30:51 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:51 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:51 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:51 user nova-compute[72863]:   </cpu>
Aug 15 13:30:51 user nova-compute[72863]:   <devices>
Aug 15 13:30:51 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:30:51 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:30:51 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk"/>
Aug 15 13:30:51 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:51 user nova-compute[72863]:     </disk>
Aug 15 13:30:51 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:51 user nova-compute[72863]:       <mac address="fa:16:3e:0d:0c:af"/>
Aug 15 13:30:51 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:51 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:51 user nova-compute[72863]:       <target dev="tapf33b5663-b6"/>
Aug 15 13:30:51 user nova-compute[72863]:     </interface>
Aug 15 13:30:51 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:51 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/console.log" append="off"/>
Aug 15 13:30:51 user nova-compute[72863]:     </serial>
Aug 15 13:30:51 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:51 user nova-compute[72863]:     <video>
Aug 15 13:30:51 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:51 user nova-compute[72863]:     </video>
Aug 15 13:30:51 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:51 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:51 user nova-compute[72863]:     </rng>
Aug 15 13:30:51 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:51 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:51 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:51 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:51 user nova-compute[72863]:   </devices>
Aug 15 13:30:51 user nova-compute[72863]: </domain>
Aug 15 13:30:51 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-545359356',display_name='tempest-ServerStableDeviceRescueTest-server-545359356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-545359356',id=29,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlwyH2myAPySn5x6PNkp2gpy5J2NL3Uyat6gEr8HGloj1v2tnIcad8iCfPcZCFitHnYRkj35+HXQO7njTkU3ciMsVD7GnbEiuyJMA/SjXMCmdM57pZro2H9qLP7LLvojA==',key_name='tempest-keypair-858193593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffea36ec1e34d8fa6c4c9c66fc4a8da',ramdisk_id='',reservation_id='r-wnc2l5je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1470876027',owner_user_name='tempest-ServerStableDeviceRescueTest-1470876027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6d22cd35c54349868cd6ecacc7340c',uuid=f6b53ea3-4cde-4488-b15e-52d522ac557e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converting VIF {"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG os_vif [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33b5663-b6, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf33b5663-b6, col_values=(('external_ids', {'iface-id': 'f33b5663-b6a2-42b9-a763-22743af05207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:0c:af', 'vm-uuid': 'f6b53ea3-4cde-4488-b15e-52d522ac557e'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:51 user nova-compute[72863]: INFO os_vif [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6')
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No VIF found with MAC fa:16:3e:0d:0c:af, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updated VIF entry in instance network info cache for port f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG nova.network.neutron [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:30:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de016d7-8d27-481f-9e5b-30462c8d591f req-cb46e5a6-9946-4a96-a74b-6e07a1bf7ad2 service nova] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:30:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:53 user nova-compute[72863]: WARNING nova.compute.manager [req-97756eb3-92d4-4cd7-b2cc-7481ffe540c6 req-f0faf52e-58c6-42dd-9518-65c97ba8e5c9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state building and task_state spawning.
Aug 15 13:30:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:30:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Creating image(s)
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start _get_guest_xml network_info=[{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5f085431-4f90-485a-bd83-d78620f3340c', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba59f9b3-1f58-40f7-a9a3-a768abf0570d', 'attached_at': '', 'detached_at': '', 'volume_id': '02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c', 'serial': '02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:30:54 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:54 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:30:54 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:30:54 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:30:54 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8af91-1132-47b8-9981-69973cb97de1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:30:54 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4ddca-8aca-41df-a6f2-1742b529abcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c] added
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a980ddc-6764-44ac-9198-5e60b1986f7d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153e0a6-a487-493d-a7fe-c468daf21f9f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyaEdtfv {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyaEdtfv" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67627cfc-4158-4a57-9b54-9485440c6f36]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kyaEdtfv'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a2c26-4c45-4d87-9284-aa76d00e41f9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0522d0aa-f334-4869-917e-4ea23860cede]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9378a895-a647-4f35-b93d-2c7f0338730f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]
Aug 15 13:30:54 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c800a0-e779-4e3d-b782-bee11999487b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa5634-540a-49bc-89d4-73c77924dfa6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:30:54 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:30:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1ef5b-030a-49b5-85e1-5ffd331123e0]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:30:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:55 user nova-compute[72863]: WARNING nova.compute.manager [req-1f5ce544-e757-40d6-92de-a331505bde62 req-1fc69684-7fd8-4a5f-bc8d-b7b5ad1c3d62 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state building and task_state spawning.
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106255.3004704, f6b53ea3-4cde-4488-b15e-52d522ac557e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Resumed (Lifecycle Event)
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance spawned successfully.
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106255.3019907, f6b53ea3-4cde-4488-b15e-52d522ac557e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Started (Lifecycle Event)
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23830323936366537', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830323936366537', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:30:55 user nova-compute[72863]: INFO nova.compute.manager [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Took 6.94 seconds to build instance.
Aug 15 13:30:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ed17c6a0-3c15-4309-bc3c-be119f83b5e1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.058s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1568403430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'pci_devices' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:30:55 user nova-compute[72863]:   <uuid>ba59f9b3-1f58-40f7-a9a3-a768abf0570d</uuid>
Aug 15 13:30:55 user nova-compute[72863]:   <name>instance-0000001c</name>
Aug 15 13:30:55 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:30:55 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:30:55 user nova-compute[72863]:   <metadata>
Aug 15 13:30:55 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:30:55 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:30:55 user nova-compute[72863]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1568403430</nova:name>
Aug 15 13:30:55 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:30:54</nova:creationTime>
Aug 15 13:30:55 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:30:55 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:30:55 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:30:55 user nova-compute[72863]:       <nova:owner>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:user uuid="7b3145c37cde4968bafdb06a74599170">tempest-ServerActionsV293TestJSON-1961177819-project-member</nova:user>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:project uuid="48481eca81a74f65b273919037f1677c">tempest-ServerActionsV293TestJSON-1961177819</nova:project>
Aug 15 13:30:55 user nova-compute[72863]:       </nova:owner>
Aug 15 13:30:55 user nova-compute[72863]:       <nova:ports>
Aug 15 13:30:55 user nova-compute[72863]:         <nova:port uuid="99f3c102-8d72-48ae-a59a-8bea7f581c01">
Aug 15 13:30:55 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 13:30:55 user nova-compute[72863]:         </nova:port>
Aug 15 13:30:55 user nova-compute[72863]:       </nova:ports>
Aug 15 13:30:55 user nova-compute[72863]:     </nova:instance>
Aug 15 13:30:55 user nova-compute[72863]:   </metadata>
Aug 15 13:30:55 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:30:55 user nova-compute[72863]:     <system>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="serial">ba59f9b3-1f58-40f7-a9a3-a768abf0570d</entry>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="uuid">ba59f9b3-1f58-40f7-a9a3-a768abf0570d</entry>
Aug 15 13:30:55 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:30:55 user nova-compute[72863]:     </system>
Aug 15 13:30:55 user nova-compute[72863]:   </sysinfo>
Aug 15 13:30:55 user nova-compute[72863]:   <os>
Aug 15 13:30:55 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:30:55 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:30:55 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:30:55 user nova-compute[72863]:   </os>
Aug 15 13:30:55 user nova-compute[72863]:   <features>
Aug 15 13:30:55 user nova-compute[72863]:     <acpi/>
Aug 15 13:30:55 user nova-compute[72863]:     <apic/>
Aug 15 13:30:55 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:30:55 user nova-compute[72863]:   </features>
Aug 15 13:30:55 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:30:55 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:30:55 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:30:55 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:30:55 user nova-compute[72863]:   </clock>
Aug 15 13:30:55 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:30:55 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:30:55 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:30:55 user nova-compute[72863]:   </cpu>
Aug 15 13:30:55 user nova-compute[72863]:   <devices>
Aug 15 13:30:55 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:30:55 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:30:55 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:30:55 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:30:55 user nova-compute[72863]:       <serial>02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c</serial>
Aug 15 13:30:55 user nova-compute[72863]:     </disk>
Aug 15 13:30:55 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:30:55 user nova-compute[72863]:       <mac address="fa:16:3e:e7:ef:42"/>
Aug 15 13:30:55 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:55 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:30:55 user nova-compute[72863]:       <target dev="tap99f3c102-8d"/>
Aug 15 13:30:55 user nova-compute[72863]:     </interface>
Aug 15 13:30:55 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:30:55 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d/console.log" append="off"/>
Aug 15 13:30:55 user nova-compute[72863]:     </serial>
Aug 15 13:30:55 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:30:55 user nova-compute[72863]:     <video>
Aug 15 13:30:55 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:30:55 user nova-compute[72863]:     </video>
Aug 15 13:30:55 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:30:55 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:30:55 user nova-compute[72863]:     </rng>
Aug 15 13:30:55 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:30:55 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:30:55 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:30:55 user nova-compute[72863]:     </memballoon>
Aug 15 13:30:55 user nova-compute[72863]:   </devices>
Aug 15 13:30:55 user nova-compute[72863]: </domain>
Aug 15 13:30:55 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1568403430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG os_vif [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f3c102-8d, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99f3c102-8d, col_values=(('external_ids', {'iface-id': '99f3c102-8d72-48ae-a59a-8bea7f581c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ef:42', 'vm-uuid': 'ba59f9b3-1f58-40f7-a9a3-a768abf0570d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:55 user nova-compute[72863]: INFO os_vif [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d')
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:30:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] No VIF found with MAC fa:16:3e:e7:ef:42, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:57 user nova-compute[72863]: WARNING nova.compute.manager [req-5bd27847-be26-45ca-8273-05d02abc12a4 req-6ad78a19-24a0-45b5-b831-764cdea3a71c service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state building and task_state spawning.
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106259.4545703, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Resumed (Lifecycle Event)
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance spawned successfully.
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106259.4546878, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Started (Lifecycle Event)
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:30:59 user nova-compute[72863]: WARNING nova.compute.manager [req-a4782e34-8d92-474e-a432-849aae2fb929 req-3f105e48-692e-4e95-9293-6a3c46fc8695 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state building and task_state spawning.
Aug 15 13:30:59 user nova-compute[72863]: INFO nova.compute.manager [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Took 16.75 seconds to build instance.
Aug 15 13:30:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f59e7267-d60d-478c-8358-32281b4a543a tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.864s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:30:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:02 user nova-compute[72863]: INFO nova.compute.manager [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Terminating instance
Aug 15 13:31:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-unplugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] No waiting events found dispatching network-vif-unplugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7fc4418d-4787-4d9e-b2ca-69931e1cace2 req-1f7fabc5-f8c9-4b8d-89c5-d7c5c400103c service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-unplugged-5263e4e8-751c-49e4-aff2-327b75064eb5 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:31:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Instance destroyed successfully.
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-231707732',display_name='tempest-TestVolumeBootPattern-server-231707732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-231707732',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-tp4cctyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:29:33Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "5263e4e8-751c-49e4-aff2-327b75064eb5", "address": "fa:16:3e:c1:1c:f4", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5263e4e8-75", "ovs_interfaceid": "5263e4e8-751c-49e4-aff2-327b75064eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_vif [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5263e4e8-75, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:31:03 user nova-compute[72863]: INFO os_vif [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5263e4e8-751c-49e4-aff2-327b75064eb5,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5263e4e8-75')
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lmJwoYyZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:31:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f545d7-df3f-4254-81f5-463a1b4b7df6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d0fc3-cc95-494d-a529-f7dbc07ac653]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:31:03 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:03 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad (non-flash)
Aug 15 13:31:03 user nova-compute[72863]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:03 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c3325f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[364fbb53-eef3-4ddf-a50f-306ab72b621d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17728c8e-17c9-4759-af45-96bf2bb44cf1]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7bdf45-abc2-4266-b6b5-6435d30089f1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e657d91-9074-4fcc-bf7d-08177acbc18f]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26438623035653539', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e96abe60', '/dev/disk/by-id/scsi-1SCST_BIOe96abe60-d8b05e59cca06844') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edc8f1f-da2c-4f6b-83b1-9e5ac310e6cb]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832359d-5c1c-4af8-a44a-708359eaccb3]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92095c-e174-4de5-8b3f-67d02e79ff6a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260]
Aug 15 13:31:03 user nova-compute[72863]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad, portal: 172.16.0.220,3260] successful.
Aug 15 13:31:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b32d8-83b1-4265-b447-9faf06a23dad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2a294-d8fa-485c-a576-8c318532f9cd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (332ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:31:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Deleting instance files /opt/stack/data/nova/instances/cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f_del
Aug 15 13:31:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Deletion of /opt/stack/data/nova/instances/cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f_del complete
Aug 15 13:31:03 user nova-compute[72863]: INFO nova.compute.manager [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 13:31:03 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:31:03 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:31:04 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:04 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Took 0.50 seconds to deallocate network for instance.
Aug 15 13:31:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-4cda6588-8659-4242-9cf0-8fdaae3c3485 req-9b1b5982-3682-47c7-ab4d-d19eec0735d5 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-deleted-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:04 user nova-compute[72863]: INFO nova.compute.manager [req-4cda6588-8659-4242-9cf0-8fdaae3c3485 req-9b1b5982-3682-47c7-ab4d-d19eec0735d5 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Neutron deleted interface 5263e4e8-751c-49e4-aff2-327b75064eb5; detaching it from the instance and deleting it from the info cache
Aug 15 13:31:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-4cda6588-8659-4242-9cf0-8fdaae3c3485 req-9b1b5982-3682-47c7-ab4d-d19eec0735d5 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-4cda6588-8659-4242-9cf0-8fdaae3c3485 req-9b1b5982-3682-47c7-ab4d-d19eec0735d5 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Detach interface failed, port_id=5263e4e8-751c-49e4-aff2-327b75064eb5, reason: Instance cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:31:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] Acquiring lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] No waiting events found dispatching network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:05 user nova-compute[72863]: WARNING nova.compute.manager [req-d8ff9b91-0ce9-477a-8351-f0d41190cb16 req-0e8e53d0-73ef-4a51-bc97-aeb57bd32288 service nova] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Received unexpected event network-vif-plugged-5263e4e8-751c-49e4-aff2-327b75064eb5 for instance with vm_state active and task_state deleting.
Aug 15 13:31:05 user nova-compute[72863]: INFO nova.compute.manager [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Took 0.82 seconds to detach 1 volumes for instance.
Aug 15 13:31:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Deleting volume: c95b32d8-83b1-4265-b447-9faf06a23dad {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:31:05 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:31:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:06 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f
Aug 15 13:31:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5a115714-2077-4b01-beae-378c6bb1b0e4 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: INFO nova.compute.manager [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Rescuing
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106263.4738896, cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:31:18 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] VM Stopped (Lifecycle Event)
Aug 15 13:31:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b9c9d63b-d41d-4af7-856f-a17fde1b44c2 None None] [instance: cc4a30dd-3db0-4232-ba5a-67ce0fa6b36f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:19 user nova-compute[72863]: WARNING nova.compute.manager [req-b9921ffa-76be-4484-8e74-8174fea7ba41 req-6a92b910-610e-4528-8a66-bcbbfe0295d5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state active and task_state rescuing.
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance destroyed successfully.
Aug 15 13:31:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Attempting a stable device rescue
Aug 15 13:31:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72863) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:31:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Creating image(s)
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "00c699eb9720da04cc382204e6c9abfc2b01830b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "00c699eb9720da04cc382204e6c9abfc2b01830b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 1.274s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.part --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG nova.virt.images [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] 4143a342-68e3-4f8e-9f9d-dd4767e47a86 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.part /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:21 user nova-compute[72863]: WARNING nova.compute.manager [req-23c69e9f-cf98-4fba-86f8-c5d29d870963 req-148de0b3-235f-42cd-ae53-b53a1daacfc5 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state active and task_state rescuing.
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.part /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.converted" returned: 0 in 0.381s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "00c699eb9720da04cc382204e6c9abfc2b01830b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.023s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "00c699eb9720da04cc382204e6c9abfc2b01830b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "00c699eb9720da04cc382204e6c9abfc2b01830b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b,backing_fmt=raw /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b,backing_fmt=raw /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue" returned: 0 in 0.049s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "00c699eb9720da04cc382204e6c9abfc2b01830b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'migration_context' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start _get_guest_xml network_info=[{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "vif_mac": "fa:16:3e:91:1b:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4143a342-68e3-4f8e-9f9d-dd4767e47a86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '01a58873-817d-4ce1-8d19-ff952e8ae7f3', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'caf7e343-dda7-4247-be10-850b462cf0a9', 'serial': 'caf7e343-dda7-4247-be10-850b462cf0a9'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'resources' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'numa_topology' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:31:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:22 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602d31e-e217-47b9-98c3-d2ea8dd2d16e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hNDexcEr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 13:31:22 user nova-compute[72863]: node.name = iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9
Aug 15 13:31:22 user nova-compute[72863]: node.tpgt = -1
Aug 15 13:31:22 user nova-compute[72863]: node.startup = automatic
Aug 15 13:31:22 user nova-compute[72863]: node.leading_login = No
Aug 15 13:31:22 user nova-compute[72863]: iface.iscsi_ifacename = default
Aug 15 13:31:22 user nova-compute[72863]: iface.net_ifacename = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.ipaddress = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.prefix_len = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.hwaddress = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.transport_name = tcp
Aug 15 13:31:22 user nova-compute[72863]: iface.initiatorname = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.vlan_id = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.vlan_priority = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.vlan_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.iface_num = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.mtu = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.port = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.bootproto = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.subnet_mask = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.gateway = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_alt_client_id = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_dns = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_learn_iqn = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_vendor_id_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_vendor_id = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.dhcp_slp_da = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.fragmentation = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.gratuitous_arp = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.incoming_forwarding = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.tos_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.tos = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.ttl = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.delayed_ack = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.tcp_nagle = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.tcp_wsf_state = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.tcp_wsf = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.tcp_timer_scale = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.tcp_timestamp = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.redirect = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.def_task_mgmt_timeout = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.header_digest = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.data_digest = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.immediate_data = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.initial_r2t = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.data_seq_inorder = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.data_pdu_inorder = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.erl = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.max_receive_data_len = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.first_burst_len = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.max_outstanding_r2t = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.max_burst_len = 0
Aug 15 13:31:22 user nova-compute[72863]: iface.chap_auth = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.bidi_chap = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.strict_login_compliance = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.discovery_auth = <empty>
Aug 15 13:31:22 user nova-compute[72863]: iface.discovery_logout = <empty>
Aug 15 13:31:22 user nova-compute[72863]: node.discovery_address = <empty>
Aug 15 13:31:22 user nova-compute[72863]: node.discovery_port = 0
Aug 15 13:31:22 user nova-compute[72863]: node.discovery_type = static
Aug 15 13:31:22 user nova-compute[72863]: node.session.initial_cmdsn = 0
Aug 15 13:31:22 user nova-compute[72863]: node.session.initial_login_retry_max = 8
Aug 15 13:31:22 user nova-compute[72863]: node.session.xmit_thread_priority = -20
Aug 15 13:31:22 user nova-compute[72863]: node.session.cmds_max = 128
Aug 15 13:31:22 user nova-compute[72863]: node.session.queue_depth = 32
Aug 15 13:31:22 user nova-compute[72863]: node.session.nr_sessions = 1
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.authmethod = CHAP
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.username = hNDexcEr
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.password = ***
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.username_in = <empty>
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.password_in = <empty>
Aug 15 13:31:22 user nova-compute[72863]: node.session.auth.chap_algs = MD5
Aug 15 13:31:22 user nova-compute[72863]: node.session.timeo.replacement_timeout = 120
Aug 15 13:31:22 user nova-compute[72863]: node.session.err_timeo.abort_timeout = 15
Aug 15 13:31:22 user nova-compute[72863]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 13:31:22 user nova-compute[72863]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 13:31:22 user nova-compute[72863]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.FastAbort = Yes
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.InitialR2T = No
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.ImmediateData = Yes
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.MaxConnections = 1
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 13:31:22 user nova-compute[72863]: node.session.iscsi.ERL = 0
Aug 15 13:31:22 user nova-compute[72863]: node.session.scan = manual
Aug 15 13:31:22 user nova-compute[72863]: node.session.reopen_max = 0
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].address = 172.16.0.220
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].port = 3260
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].startup = manual
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].tcp.window_size = 524288
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].tcp.type_of_service = 0
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].timeo.logout_timeout = 15
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].timeo.login_timeout = 15
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].timeo.auth_timeout = 45
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.DataDigest = None
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.IFMarker = No
Aug 15 13:31:22 user nova-compute[72863]: node.conn[0].iscsi.OFMarker = No
Aug 15 13:31:22 user nova-compute[72863]: # END RECORD
Aug 15 13:31:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf188e-5ebd-4ed6-98da-6689afa0ef25]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bd450a-ff40-4edc-9b14-480c71f3e895]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNDexcEr {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNDexcEr" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a020eb76-757e-4741-b5e2-85689cc7d0f5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNDexcEr'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9dc475-a294-4706-aa68-862aa97717d6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace0b3d8-99a8-4147-89f6-1a16b3cb49b7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:22 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:22 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] HCTL ('35', '0', '0', 0) found on session 22 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15571a-c3db-40e1-a5cc-929a8e1ac7d6]: (4, ('0 0 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Searching for a device in session 22 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23063663361366666', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063663361366666', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390587892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390587892',id=24,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-q8obhbh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:29:54Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "vif_mac": "fa:16:3e:91:1b:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "vif_mac": "fa:16:3e:91:1b:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:31:22 user nova-compute[72863]:   <uuid>5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</uuid>
Aug 15 13:31:22 user nova-compute[72863]:   <name>instance-00000018</name>
Aug 15 13:31:22 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:31:22 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:31:22 user nova-compute[72863]:   <metadata>
Aug 15 13:31:22 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:31:22 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1390587892</nova:name>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:31:22</nova:creationTime>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:31:22 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:31:22 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:owner>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:user uuid="f28612e758464797a56a4b7ea233ae66">tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member</nova:user>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:project uuid="03e9e6721b634d2fb974f7a10c6e0359">tempest-ServerBootFromVolumeStableRescueTest-603513238</nova:project>
Aug 15 13:31:22 user nova-compute[72863]:       </nova:owner>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:31:22 user nova-compute[72863]:       <nova:ports>
Aug 15 13:31:22 user nova-compute[72863]:         <nova:port uuid="a47a22fa-295c-43a5-aa09-1174db28999f">
Aug 15 13:31:22 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:31:22 user nova-compute[72863]:         </nova:port>
Aug 15 13:31:22 user nova-compute[72863]:       </nova:ports>
Aug 15 13:31:22 user nova-compute[72863]:     </nova:instance>
Aug 15 13:31:22 user nova-compute[72863]:   </metadata>
Aug 15 13:31:22 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:31:22 user nova-compute[72863]:     <system>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="serial">5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</entry>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="uuid">5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7</entry>
Aug 15 13:31:22 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:31:22 user nova-compute[72863]:     </system>
Aug 15 13:31:22 user nova-compute[72863]:   </sysinfo>
Aug 15 13:31:22 user nova-compute[72863]:   <os>
Aug 15 13:31:22 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:31:22 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:31:22 user nova-compute[72863]:   </os>
Aug 15 13:31:22 user nova-compute[72863]:   <features>
Aug 15 13:31:22 user nova-compute[72863]:     <acpi/>
Aug 15 13:31:22 user nova-compute[72863]:     <apic/>
Aug 15 13:31:22 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:31:22 user nova-compute[72863]:   </features>
Aug 15 13:31:22 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:31:22 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:31:22 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:31:22 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:31:22 user nova-compute[72863]:   </clock>
Aug 15 13:31:22 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:31:22 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:31:22 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:31:22 user nova-compute[72863]:   </cpu>
Aug 15 13:31:22 user nova-compute[72863]:   <devices>
Aug 15 13:31:22 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:31:22 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:31:22 user nova-compute[72863]:       <source dev="/dev/sdd"/>
Aug 15 13:31:22 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:31:22 user nova-compute[72863]:       <serial>caf7e343-dda7-4247-be10-850b462cf0a9</serial>
Aug 15 13:31:22 user nova-compute[72863]:     </disk>
Aug 15 13:31:22 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:31:22 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:31:22 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue"/>
Aug 15 13:31:22 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:31:22 user nova-compute[72863]:       <boot order="1"/>
Aug 15 13:31:22 user nova-compute[72863]:     </disk>
Aug 15 13:31:22 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:31:22 user nova-compute[72863]:       <mac address="fa:16:3e:91:1b:40"/>
Aug 15 13:31:22 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:31:22 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:31:22 user nova-compute[72863]:       <target dev="tapa47a22fa-29"/>
Aug 15 13:31:22 user nova-compute[72863]:     </interface>
Aug 15 13:31:22 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:31:22 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/console.log" append="off"/>
Aug 15 13:31:22 user nova-compute[72863]:     </serial>
Aug 15 13:31:22 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:31:22 user nova-compute[72863]:     <video>
Aug 15 13:31:22 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:31:22 user nova-compute[72863]:     </video>
Aug 15 13:31:22 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:31:22 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:31:22 user nova-compute[72863]:     </rng>
Aug 15 13:31:22 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:31:22 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:31:22 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:31:22 user nova-compute[72863]:     </memballoon>
Aug 15 13:31:22 user nova-compute[72863]:   </devices>
Aug 15 13:31:22 user nova-compute[72863]: </domain>
Aug 15 13:31:22 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance destroyed successfully.
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] No VIF found with MAC fa:16:3e:91:1b:40, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:31:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:26 user nova-compute[72863]: WARNING nova.compute.manager [req-7acc1420-2098-4fc0-8478-e732a44c88d8 req-0fd220d3-2958-46e1-9b73-79ff0c3ea158 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state active and task_state rescuing.
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-changed-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Refreshing instance network info cache due to event network-changed-35aeaef8-bfd4-4620-8b30-26d103f2510c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] Acquiring lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] Acquired lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.network.neutron [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Refreshing network info cache for port 35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:26 user nova-compute[72863]: WARNING nova.compute.manager [req-63418d73-17f3-454a-99c5-f3b1df84d851 req-d645f891-c126-401d-b048-894ffcb1516f service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state active and task_state rescuing.
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106286.2250924, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:31:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Resumed (Lifecycle Event)
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9e9ae20f-13dd-4a81-9409-e82edd36f7d2 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:31:26 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:26 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6416MB free_disk=25.57052993774414GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:31:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106286.2261014, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:31:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Started (Lifecycle Event)
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance deaee06a-0a48-45c7-b6d3-060b1778bf11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 36996814-2797-4261-80dd-59171815aef0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.network.neutron [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updated VIF entry in instance network info cache for port 35aeaef8-bfd4-4620-8b30-26d103f2510c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG nova.network.neutron [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updating instance_info_cache with network_info: [{"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-59188f93-5de2-4103-9d26-b820486f72d9 req-3d6329a3-80d5-4a4b-8434-a6524e243d64 service nova] Releasing lock "refresh_cache-deaee06a-0a48-45c7-b6d3-060b1778bf11" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:31:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:31:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:31:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:31:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:28 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:29 user nova-compute[72863]: INFO nova.compute.manager [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Attaching volume c9097f9c-1d77-4c3b-a79b-09b0a179ab4f to /dev/vdb
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.utils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c70765-cd06-49c4-bddb-dc4f168f6119]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e5c0c-e21f-483b-b45b-04550bcfe855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eefd13-6938-433f-b427-5e7fe39c7a9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af269505-776d-4dce-a317-dcff9bcfdbf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:31:29 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:31:29 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d6184-e897-4c1d-ae60-7b0f5ebc7014]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG os_brick.utils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updating existing volume attachment record: d4305058-1a21-489b-9363-8ff59640f18a {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:31:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:31:30 user nova-compute[72863]: INFO nova.compute.claims [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Claim successful on node user
Aug 15 13:31:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:31:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:31:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.policy [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '826608d086c948d499935fa979257ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916d31a5dc5443e9bbe7045f316d0b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:31:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Creating image(s)
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "/opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "/opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.276s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk 1073741824" returned: 0 in 0.062s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Successfully created port: 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:31:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Cannot resize image /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.objects.instance [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'migration_context' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Ensure instance console log exists: /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Successfully updated port: 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-changed-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Refreshing instance network info cache due to event network-changed-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] Acquiring lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] Acquired lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG nova.network.neutron [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Refreshing network info cache for port 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:31:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updating instance_info_cache with network_info: [{"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e21debbd-9ace-472c-84ad-1574063ddfee req-ce4c13d5-5eb8-490d-b104-d83e4abac210 service nova] Releasing lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquired lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating instance_info_cache with network_info: [{"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Releasing lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance network_info: |[{"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Start _get_guest_xml network_info=[{"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:31:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-750912192',display_name='tempest-VolumesSnapshotTestJSON-instance-750912192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-750912192',id=30,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQzXTU7NUvGkym6MFinHsUzzCecuGxVMQk2u/IaHRMtsYs8LNADS4/Jcgu5fvZVY4SbYaYWUGJGtblzBxGWjIi5lsMYxsr85ZXbLyYXPj+zkdAriyN9mq7odlt/d+RtGA==',key_name='tempest-keypair-246562273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-bkrfhsha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=dc2d8463-dd59-47ca-8142-28bd790cf247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'pci_devices' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:31:33 user nova-compute[72863]:   <uuid>dc2d8463-dd59-47ca-8142-28bd790cf247</uuid>
Aug 15 13:31:33 user nova-compute[72863]:   <name>instance-0000001e</name>
Aug 15 13:31:33 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:31:33 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:31:33 user nova-compute[72863]:   <metadata>
Aug 15 13:31:33 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:31:33 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-750912192</nova:name>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:31:33</nova:creationTime>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:31:33 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:31:33 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:owner>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:user uuid="826608d086c948d499935fa979257ffa">tempest-VolumesSnapshotTestJSON-1485635322-project-member</nova:user>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:project uuid="916d31a5dc5443e9bbe7045f316d0b7f">tempest-VolumesSnapshotTestJSON-1485635322</nova:project>
Aug 15 13:31:33 user nova-compute[72863]:       </nova:owner>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:31:33 user nova-compute[72863]:       <nova:ports>
Aug 15 13:31:33 user nova-compute[72863]:         <nova:port uuid="0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f">
Aug 15 13:31:33 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:31:33 user nova-compute[72863]:         </nova:port>
Aug 15 13:31:33 user nova-compute[72863]:       </nova:ports>
Aug 15 13:31:33 user nova-compute[72863]:     </nova:instance>
Aug 15 13:31:33 user nova-compute[72863]:   </metadata>
Aug 15 13:31:33 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:31:33 user nova-compute[72863]:     <system>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="serial">dc2d8463-dd59-47ca-8142-28bd790cf247</entry>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="uuid">dc2d8463-dd59-47ca-8142-28bd790cf247</entry>
Aug 15 13:31:33 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:31:33 user nova-compute[72863]:     </system>
Aug 15 13:31:33 user nova-compute[72863]:   </sysinfo>
Aug 15 13:31:33 user nova-compute[72863]:   <os>
Aug 15 13:31:33 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:31:33 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:31:33 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:31:33 user nova-compute[72863]:   </os>
Aug 15 13:31:33 user nova-compute[72863]:   <features>
Aug 15 13:31:33 user nova-compute[72863]:     <acpi/>
Aug 15 13:31:33 user nova-compute[72863]:     <apic/>
Aug 15 13:31:33 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:31:33 user nova-compute[72863]:   </features>
Aug 15 13:31:33 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:31:33 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:31:33 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:31:33 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:31:33 user nova-compute[72863]:   </clock>
Aug 15 13:31:33 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:31:33 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:31:33 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:31:33 user nova-compute[72863]:   </cpu>
Aug 15 13:31:33 user nova-compute[72863]:   <devices>
Aug 15 13:31:33 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:31:33 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:31:33 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk"/>
Aug 15 13:31:33 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:31:33 user nova-compute[72863]:     </disk>
Aug 15 13:31:33 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:31:33 user nova-compute[72863]:       <mac address="fa:16:3e:ef:e9:22"/>
Aug 15 13:31:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:31:33 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:31:33 user nova-compute[72863]:       <target dev="tap0a0ebd10-49"/>
Aug 15 13:31:33 user nova-compute[72863]:     </interface>
Aug 15 13:31:33 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:31:33 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/console.log" append="off"/>
Aug 15 13:31:33 user nova-compute[72863]:     </serial>
Aug 15 13:31:33 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:31:33 user nova-compute[72863]:     <video>
Aug 15 13:31:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:31:33 user nova-compute[72863]:     </video>
Aug 15 13:31:33 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:31:33 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:31:33 user nova-compute[72863]:     </rng>
Aug 15 13:31:33 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:31:33 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:31:33 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:31:33 user nova-compute[72863]:     </memballoon>
Aug 15 13:31:33 user nova-compute[72863]:   </devices>
Aug 15 13:31:33 user nova-compute[72863]: </domain>
Aug 15 13:31:33 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-750912192',display_name='tempest-VolumesSnapshotTestJSON-instance-750912192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-750912192',id=30,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQzXTU7NUvGkym6MFinHsUzzCecuGxVMQk2u/IaHRMtsYs8LNADS4/Jcgu5fvZVY4SbYaYWUGJGtblzBxGWjIi5lsMYxsr85ZXbLyYXPj+zkdAriyN9mq7odlt/d+RtGA==',key_name='tempest-keypair-246562273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-bkrfhsha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=dc2d8463-dd59-47ca-8142-28bd790cf247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG os_vif [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0ebd10-49, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a0ebd10-49, col_values=(('external_ids', {'iface-id': '0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:e9:22', 'vm-uuid': 'dc2d8463-dd59-47ca-8142-28bd790cf247'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:33 user nova-compute[72863]: INFO os_vif [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49')
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:31:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No VIF found with MAC fa:16:3e:ef:e9:22, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:31:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] No waiting events found dispatching network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:35 user nova-compute[72863]: WARNING nova.compute.manager [req-c1d30653-4e8e-45c7-b2a6-c11f4d88d276 req-5b9ad343-f9e9-453f-8bad-1ea3f7248ead service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received unexpected event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f for instance with vm_state building and task_state spawning.
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106297.256775, dc2d8463-dd59-47ca-8142-28bd790cf247 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] VM Resumed (Lifecycle Event)
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance spawned successfully.
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106297.2600837, dc2d8463-dd59-47ca-8142-28bd790cf247 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] VM Started (Lifecycle Event)
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] No waiting events found dispatching network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:31:37 user nova-compute[72863]: WARNING nova.compute.manager [req-db66991c-4852-431a-bb9f-74dde1585b23 req-25d8cc61-1ad9-4244-9423-1436e2de123e service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received unexpected event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f for instance with vm_state building and task_state spawning.
Aug 15 13:31:37 user nova-compute[72863]: INFO nova.compute.manager [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Took 7.07 seconds to build instance.
Aug 15 13:31:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24413abc-186d-4649-9749-8a547165b7d1 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JomNzapD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:31:39 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:39 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:39 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083fdb4-5469-4d54-a297-85f808fcb308]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:31:39 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.063s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f248bb1-2b50-458c-80e9-f77db363332b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f] added
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f6fd6-ab07-4a4a-8148-bf4ff45b029b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f72cd8-92fd-4a42-b32b-83b067727341]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JomNzapD {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JomNzapD" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a544ea9-6581-42f8-8d64-7208db14daee]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JomNzapD'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79504a32-835a-42eb-a450-342d987c6353]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbf374-f342-46c6-a1cb-93625efe8af1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27a482-82c6-45a9-a44b-f47c84d52997]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260]
Aug 15 13:31:39 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260] successful.
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84601ee-256a-453a-a357-62a0668b954e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe1a62-d2c9-489d-b54d-d7f6506592e7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:39 user nova-compute[72863]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)
Aug 15 13:31:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc4e988-97aa-4a1b-9ea8-f505c18dd41f]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:31:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JomNzapD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23139353836363432', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139353836363432', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:31:40 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:31:40 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:31:40 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:31:40 user nova-compute[72863]:   <serial>c9097f9c-1d77-4c3b-a79b-09b0a179ab4f</serial>
Aug 15 13:31:40 user nova-compute[72863]: </disk>
Aug 15 13:31:40 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:31:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:31:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:31:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:d9:98:15, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:31:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e98d8435-7ae9-4505-a112-649464b8f981 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.166s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:31:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:31:42 user nova-compute[72863]: INFO nova.compute.manager [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Detaching volume c9097f9c-1d77-4c3b-a79b-09b0a179ab4f
Aug 15 13:31:42 user nova-compute[72863]: INFO nova.virt.block_device [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Attempting to driver detach volume c9097f9c-1d77-4c3b-a79b-09b0a179ab4f from mountpoint /dev/vdb
Aug 15 13:31:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Attempting to detach device vdb from instance deaee06a-0a48-45c7-b6d3-060b1778bf11 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:31:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:31:42 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:31:42 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:31:42 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:31:42 user nova-compute[72863]:   <serial>c9097f9c-1d77-4c3b-a79b-09b0a179ab4f</serial>
Aug 15 13:31:42 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:31:42 user nova-compute[72863]: </disk>
Aug 15 13:31:42 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:31:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance deaee06a-0a48-45c7-b6d3-060b1778bf11 from the persistent domain config.
Aug 15 13:31:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance deaee06a-0a48-45c7-b6d3-060b1778bf11 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:31:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:31:42 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:31:42 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:31:42 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:31:42 user nova-compute[72863]:   <serial>c9097f9c-1d77-4c3b-a79b-09b0a179ab4f</serial>
Aug 15 13:31:42 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:31:42 user nova-compute[72863]: </disk>
Aug 15 13:31:42 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106303.063876, deaee06a-0a48-45c7-b6d3-060b1778bf11 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:31:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance deaee06a-0a48-45c7-b6d3-060b1778bf11 from the live domain config.
Aug 15 13:31:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JomNzapD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:31:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4aae16-6153-4336-84de-fec9e875f80b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c2bd4-f4e1-4cf1-ba97-26f0b87733a8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:43 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:43 user nova-compute[72863]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)
Aug 15 13:31:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:31:43 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:31:43 user nova-compute[72863]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f (non-flash)
Aug 15 13:31:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4d6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a2757-d3b4-4a2c-a873-4a8ce0495e72]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12590171-eaaf-4afb-b052-c1388da9f949]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010b8d6-64c8-4a02-9c7d-459f2cc44a8d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56fa12-a1a7-42a6-890e-77b4759b9ef1]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710974a-b86b-4cfa-a280-6a15f93281f6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc93e19-ec7a-4b6f-860e-1e4369d4fc2b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260]
Aug 15 13:31:43 user nova-compute[72863]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f, portal: 172.16.0.220,3260] successful.
Aug 15 13:31:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9097f9c-1d77-4c3b-a79b-09b0a179ab4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a2dadd-5edf-4153-ab53-afa4bd5aa9f0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== disconnect_volume: return (284ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:31:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:44 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:31:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9db2746-f568-4507-94e7-973a4fcfcfc4 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:31:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:31:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-changed-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Refreshing instance network info cache due to event network-changed-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] Acquiring lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] Acquired lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.network.neutron [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Refreshing network info cache for port 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'flavor' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.network.neutron [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updated VIF entry in instance network info cache for port 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.network.neutron [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating instance_info_cache with network_info: [{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1b2f18fa-d2ee-4a73-833f-f6c15f862751 req-339dfaa1-75bd-49d9-8b68-9d093460a201 service nova] Releasing lock "refresh_cache-246b401a-83c6-40d0-8f30-95af5cbebc35" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:32:16 user nova-compute[72863]: INFO nova.compute.claims [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Claim successful on node user
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:17 user nova-compute[72863]: INFO nova.compute.manager [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attaching volume fc498af9-1027-4d0f-b25e-2d6cf3c99705 to /dev/vdb
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d6d923-8d58-4f92-a9d1-b2129d4fbc90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a8836-296b-429d-85f7-5f03186e7623]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af73b3-4d17-46e8-92fc-a9a9cf596bfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5124dd1-ba77-468b-8d4e-11be757fd6d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:17 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249c0b3-3b13-41c6-a859-a9b77bddeb1d]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating existing volume attachment record: 3d8219cb-637f-4256-8a88-442ad006bf95 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.427s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:32:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:32:17 user nova-compute[72863]: INFO nova.virt.block_device [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Booting with volume c7abe1e2-86d3-45e3-bad4-9be6c758589b at /dev/vda
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.policy [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e8847-4e04-4610-9e88-9a7317070cea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee51a6de-c7c9-404d-9456-17801c773856]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61681b65-88c6-467a-aa9b-b0f7af3cd983]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bd5856-17f0-420b-8541-844a8b7d730e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:17 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66665b25-4a4e-40e5-ac04-a0060c6cb085]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG os_brick.utils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updating existing volume attachment record: 79847cd9-85d3-49fb-91ec-e18f1f571008 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Successfully created port: f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Successfully updated port: f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-changed-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Refreshing instance network info cache due to event network-changed-f53d3ea7-feb7-4e56-b28b-74e26e418800. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] Acquiring lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updating instance_info_cache with network_info: [{"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Instance network_info: |[{"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] Acquired lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG nova.network.neutron [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Refreshing network info cache for port f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updated VIF entry in instance network info cache for port f53d3ea7-feb7-4e56-b28b-74e26e418800. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updating instance_info_cache with network_info: [{"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fa6482a0-c15f-4d71-9153-8f496ea5c685 req-a19a310c-75ae-44eb-8204-c6fb3b289912 service nova] Releasing lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "36996814-2797-4261-80dd-59171815aef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "36996814-2797-4261-80dd-59171815aef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:20 user nova-compute[72863]: INFO nova.compute.manager [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Terminating instance
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-unplugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] Acquiring lock "36996814-2797-4261-80dd-59171815aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] No waiting events found dispatching network-vif-unplugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-09385444-df93-4900-b890-4015e2543e7f req-1b6559cf-6e76-46bd-a288-721edfcfb417 service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-unplugged-ba3a589c-323e-4b17-8919-49eef41fc511 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 36996814-2797-4261-80dd-59171815aef0] Instance destroyed successfully.
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'resources' on Instance uuid 36996814-2797-4261-80dd-59171815aef0 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-251689554',display_name='tempest-ServersNegativeTestJSON-server-251689554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-251689554',id=27,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-9wgjc30c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:30:40Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=36996814-2797-4261-80dd-59171815aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "ba3a589c-323e-4b17-8919-49eef41fc511", "address": "fa:16:3e:7d:39:0e", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba3a589c-32", "ovs_interfaceid": "ba3a589c-323e-4b17-8919-49eef41fc511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG os_vif [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba3a589c-32, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:21 user nova-compute[72863]: INFO os_vif [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:0e,bridge_name='br-int',has_traffic_filtering=True,id=ba3a589c-323e-4b17-8919-49eef41fc511,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba3a589c-32')
Aug 15 13:32:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Deleting instance files /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0_del
Aug 15 13:32:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Deletion of /opt/stack/data/nova/instances/36996814-2797-4261-80dd-59171815aef0_del complete
Aug 15 13:32:21 user nova-compute[72863]: INFO nova.compute.manager [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 36996814-2797-4261-80dd-59171815aef0] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 36996814-2797-4261-80dd-59171815aef0] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 36996814-2797-4261-80dd-59171815aef0] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 36996814-2797-4261-80dd-59171815aef0] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.compute.manager [req-efb5bd6e-fe50-40c7-a91c-51da9e1b24af req-e6312628-1919-4af2-a44e-f3e89e17a1cd service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-deleted-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:22 user nova-compute[72863]: INFO nova.compute.manager [req-efb5bd6e-fe50-40c7-a91c-51da9e1b24af req-e6312628-1919-4af2-a44e-f3e89e17a1cd service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Neutron deleted interface ba3a589c-323e-4b17-8919-49eef41fc511; detaching it from the instance and deleting it from the info cache
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-efb5bd6e-fe50-40c7-a91c-51da9e1b24af req-e6312628-1919-4af2-a44e-f3e89e17a1cd service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:22 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 36996814-2797-4261-80dd-59171815aef0] Took 0.73 seconds to deallocate network for instance.
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.compute.manager [req-efb5bd6e-fe50-40c7-a91c-51da9e1b24af req-e6312628-1919-4af2-a44e-f3e89e17a1cd service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Detach interface failed, port_id=ba3a589c-323e-4b17-8919-49eef41fc511, reason: Instance 36996814-2797-4261-80dd-59171815aef0 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:22 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Deleted allocations for instance 36996814-2797-4261-80dd-59171815aef0
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] Acquiring lock "36996814-2797-4261-80dd-59171815aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] Lock "36996814-2797-4261-80dd-59171815aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] No waiting events found dispatching network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:23 user nova-compute[72863]: WARNING nova.compute.manager [req-bbf86629-3dd1-4ce2-9976-6b846f60f9b6 req-134ef74b-65d9-4b60-82ad-886dcd88757a service nova] [instance: 36996814-2797-4261-80dd-59171815aef0] Received unexpected event network-vif-plugged-ba3a589c-323e-4b17-8919-49eef41fc511 for instance with vm_state deleted and task_state None.
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c5801b3c-20c1-4d6c-9e54-1bfb2d3f56ad tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "36996814-2797-4261-80dd-59171815aef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:32:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6369MB free_disk=25.433120727539062GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 86c46771-bc19-4440-9ed1-d713a003b231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance deaee06a-0a48-45c7-b6d3-060b1778bf11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance dc2d8463-dd59-47ca-8142-28bd790cf247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:25 user nova-compute[72863]: INFO nova.compute.manager [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Terminating instance
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-efa626c3-fb38-4a5d-8b30-3ed15a1efc71 req-b0687373-3a22-4936-bed0-919ca2189bec service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-unplugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:25 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:32:26 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Instance destroyed successfully.
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'resources' on Instance uuid 86c46771-bc19-4440-9ed1-d713a003b231 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1730461208',display_name='tempest-AttachVolumeTestJSON-server-1730461208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1730461208',id=4,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt3kKDkHJadfct1nMTM/3j4Akd1qZP2BBBI/6IuadwAyDPOJyc1/M96k19Jv1mzpMWWBhlT/ABpTgPSQ9QvBUuCBABEDQRT2IZXXrKYI9vXlgAZGmPzZTOZQ3y7Hf0HPw==',key_name='tempest-keypair-1615360776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-ag95gd4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=86c46771-bc19-4440-9ed1-d713a003b231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "address": "fa:16:3e:03:ed:b5", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b260b4c-be", "ovs_interfaceid": "2b260b4c-bea8-4b7d-9131-0a938ed031e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_vif [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b260b4c-be, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:26 user nova-compute[72863]: INFO os_vif [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ed:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b260b4c-bea8-4b7d-9131-0a938ed031e6,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b260b4c-be')
Aug 15 13:32:26 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Deleting instance files /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231_del
Aug 15 13:32:26 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Deletion of /opt/stack/data/nova/instances/86c46771-bc19-4440-9ed1-d713a003b231_del complete
Aug 15 13:32:26 user nova-compute[72863]: INFO nova.compute.manager [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:26 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:26 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:26 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8610d-e3c0-45f5-b2cf-05d363d0e397]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:32:26 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cfa260-09d1-4591-8d82-734f64a93465]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705] added
Aug 15 13:32:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6191c-0e5e-4160-814e-05f62c56faaf]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5233f4-9b9e-4ec9-a871-a910e42006a9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCzqpOLi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCzqpOLi" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99bac4-43c9-4b20-a91a-9a4b6cd74057]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCzqpOLi'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a096f5-3249-40e6-ada7-c7fb00921a47]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[921445e6-6815-43fb-91b1-a90cb05bbc9f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:26 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:26 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[339350de-26af-4665-bf9c-a24b816f9d76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]
Aug 15 13:32:26 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81aeac-951a-48f7-9507-f7b93c7d25ff]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd6b64-03ae-4334-9129-ef88f4e69a74]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:27 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:27 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:27 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:27 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31091399-519b-4127-b35a-b3b3691120a4]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:27 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Took 0.93 seconds to deallocate network for instance.
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bde56653-0f50-406d-8a08-14b5031837ed req-c96401a7-15cb-4e2b-8a72-c5ad764f50aa service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-deleted-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:27 user nova-compute[72863]: INFO nova.compute.manager [req-bde56653-0f50-406d-8a08-14b5031837ed req-c96401a7-15cb-4e2b-8a72-c5ad764f50aa service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Neutron deleted interface 2b260b4c-bea8-4b7d-9131-0a938ed031e6; detaching it from the instance and deleting it from the info cache
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.network.neutron [req-bde56653-0f50-406d-8a08-14b5031837ed req-c96401a7-15cb-4e2b-8a72-c5ad764f50aa service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bde56653-0f50-406d-8a08-14b5031837ed req-c96401a7-15cb-4e2b-8a72-c5ad764f50aa service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Detach interface failed, port_id=2b260b4c-bea8-4b7d-9131-0a938ed031e6, reason: Instance 86c46771-bc19-4440-9ed1-d713a003b231 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] Acquiring lock "86c46771-bc19-4440-9ed1-d713a003b231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] Lock "86c46771-bc19-4440-9ed1-d713a003b231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] No waiting events found dispatching network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:27 user nova-compute[72863]: WARNING nova.compute.manager [req-30b2f0d9-6122-4a91-b96b-d88f4d3e5d33 req-a2ce81c5-266b-4032-b4e2-eaab602a8655 service nova] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Received unexpected event network-vif-plugged-2b260b4c-bea8-4b7d-9131-0a938ed031e6 for instance with vm_state deleted and task_state None.
Aug 15 13:32:27 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Deleted allocations for instance 86c46771-bc19-4440-9ed1-d713a003b231
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0bef31b1-12bf-4a42-a504-8002b0880a9f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "86c46771-bc19-4440-9ed1-d713a003b231" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.474s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:32:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Creating image(s)
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Ensure instance console log exists: /opt/stack/data/nova/instances/2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Start _get_guest_xml network_info=[{"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '79847cd9-85d3-49fb-91ec-e18f1f571008', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwDTdRnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7abe1e2-86d3-45e3-bad4-9be6c758589b', 'serial': 'c7abe1e2-86d3-45e3-bad4-9be6c758589b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:32:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:32:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwDTdRnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23133333936366531', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133333936366531', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.238s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:28 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:28 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'flavor' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23d6a2d-4d99-44fd-bdac-e0b4ccdb185b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:32:28 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:32:28 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:32:28 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:32:28 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:32:28 user nova-compute[72863]:   <serial>fc498af9-1027-4d0f-b25e-2d6cf3c99705</serial>
Aug 15 13:32:28 user nova-compute[72863]: </disk>
Aug 15 13:32:28 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b7cc5f-5117-4865-8400-92fc8cb3c67e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b] added
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5e3cb-1bb7-4faa-be54-537b4111b60a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e1bbb-66d1-42d9-9523-841891631ffb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwDTdRnu {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwDTdRnu" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da61ed-439d-4640-941d-207bc25d6b1f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwDTdRnu'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2447ea-e6d2-42d4-9a64-8564b0de6978]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[48622f37-e32d-464b-a370-6f6567414778]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa8edbc-73a9-482c-bc14-ec36e585dff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260]
Aug 15 13:32:28 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a9b1f-162d-44ae-9666-05b791297aa6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456e957-0f9c-4f6a-b137-bcd70dc75149]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:28 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a055f464-b90e-4ce5-829f-4e7453ef89b4]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:ce:b8:7e, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:32:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fbc17d41-b1cf-48d1-8618-d54ec150cec1 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.590s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwDTdRnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1537ms) {'type': 'block', 'scsi_wwn': '23532616337393331', 'path': '/dev/sde'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532616337393331', 'path': '/dev/sde'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1335362405',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKot62ZOMZduor4DCFn7hTFSh1KDePpoEwuLNAPRHWbsQ0smdlRnRtuT5juPBb85kgv36Mgh50UBD9iLWUIK0Rwd/iCDtAVY+OGDrn7ec9XW2efnTBERyyvtoydbpHkdiA==',key_name='tempest-keypair-1389449953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-onew3d92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:32:29 user nova-compute[72863]:   <uuid>2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd</uuid>
Aug 15 13:32:29 user nova-compute[72863]:   <name>instance-0000001f</name>
Aug 15 13:32:29 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:32:29 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:32:29 user nova-compute[72863]:   <metadata>
Aug 15 13:32:29 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:32:29 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:32:29 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1335362405</nova:name>
Aug 15 13:32:29 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:32:27</nova:creationTime>
Aug 15 13:32:29 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:32:29 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:32:29 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:32:29 user nova-compute[72863]:       <nova:owner>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:32:29 user nova-compute[72863]:       </nova:owner>
Aug 15 13:32:29 user nova-compute[72863]:       <nova:ports>
Aug 15 13:32:29 user nova-compute[72863]:         <nova:port uuid="f53d3ea7-feb7-4e56-b28b-74e26e418800">
Aug 15 13:32:29 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:32:29 user nova-compute[72863]:         </nova:port>
Aug 15 13:32:29 user nova-compute[72863]:       </nova:ports>
Aug 15 13:32:29 user nova-compute[72863]:     </nova:instance>
Aug 15 13:32:29 user nova-compute[72863]:   </metadata>
Aug 15 13:32:29 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:32:29 user nova-compute[72863]:     <system>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="serial">2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd</entry>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="uuid">2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd</entry>
Aug 15 13:32:29 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:32:29 user nova-compute[72863]:     </system>
Aug 15 13:32:29 user nova-compute[72863]:   </sysinfo>
Aug 15 13:32:29 user nova-compute[72863]:   <os>
Aug 15 13:32:29 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:32:29 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:32:29 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:32:29 user nova-compute[72863]:   </os>
Aug 15 13:32:29 user nova-compute[72863]:   <features>
Aug 15 13:32:29 user nova-compute[72863]:     <acpi/>
Aug 15 13:32:29 user nova-compute[72863]:     <apic/>
Aug 15 13:32:29 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:32:29 user nova-compute[72863]:   </features>
Aug 15 13:32:29 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:32:29 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:32:29 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:32:29 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:32:29 user nova-compute[72863]:   </clock>
Aug 15 13:32:29 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:32:29 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:32:29 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:32:29 user nova-compute[72863]:   </cpu>
Aug 15 13:32:29 user nova-compute[72863]:   <devices>
Aug 15 13:32:29 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:32:29 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:32:29 user nova-compute[72863]:       <source dev="/dev/sde"/>
Aug 15 13:32:29 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:32:29 user nova-compute[72863]:       <serial>c7abe1e2-86d3-45e3-bad4-9be6c758589b</serial>
Aug 15 13:32:29 user nova-compute[72863]:     </disk>
Aug 15 13:32:29 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:32:29 user nova-compute[72863]:       <mac address="fa:16:3e:03:1a:a5"/>
Aug 15 13:32:29 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:32:29 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:32:29 user nova-compute[72863]:       <target dev="tapf53d3ea7-fe"/>
Aug 15 13:32:29 user nova-compute[72863]:     </interface>
Aug 15 13:32:29 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:32:29 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd/console.log" append="off"/>
Aug 15 13:32:29 user nova-compute[72863]:     </serial>
Aug 15 13:32:29 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:32:29 user nova-compute[72863]:     <video>
Aug 15 13:32:29 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:32:29 user nova-compute[72863]:     </video>
Aug 15 13:32:29 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:32:29 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:32:29 user nova-compute[72863]:     </rng>
Aug 15 13:32:29 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:32:29 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:32:29 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:32:29 user nova-compute[72863]:     </memballoon>
Aug 15 13:32:29 user nova-compute[72863]:   </devices>
Aug 15 13:32:29 user nova-compute[72863]: </domain>
Aug 15 13:32:29 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1335362405',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKot62ZOMZduor4DCFn7hTFSh1KDePpoEwuLNAPRHWbsQ0smdlRnRtuT5juPBb85kgv36Mgh50UBD9iLWUIK0Rwd/iCDtAVY+OGDrn7ec9XW2efnTBERyyvtoydbpHkdiA==',key_name='tempest-keypair-1389449953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-onew3d92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG os_vif [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf53d3ea7-fe, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf53d3ea7-fe, col_values=(('external_ids', {'iface-id': 'f53d3ea7-feb7-4e56-b28b-74e26e418800', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:1a:a5', 'vm-uuid': '2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:29 user nova-compute[72863]: INFO os_vif [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe')
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:03:1a:a5, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:32:29 user nova-compute[72863]: INFO nova.compute.manager [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Rebuilding instance
Aug 15 13:32:29 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'trusted_certs' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_requests' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_devices' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'resources' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'migration_context' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72863) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:30 user nova-compute[72863]: WARNING nova.compute.manager [req-9e1e263d-96cb-4a03-9867-6e00ae710c81 req-7d51e9b1-9324-4dcc-91fd-ddb35dff3604 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance destroyed successfully.
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: INFO nova.compute.manager [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Detaching volume fc498af9-1027-4d0f-b25e-2d6cf3c99705
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: INFO nova.virt.block_device [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attempting to driver detach volume fc498af9-1027-4d0f-b25e-2d6cf3c99705 from mountpoint /dev/vdb
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Attempting to detach device vdb from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:32:31 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:32:31 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:32:31 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:32:31 user nova-compute[72863]:   <serial>fc498af9-1027-4d0f-b25e-2d6cf3c99705</serial>
Aug 15 13:32:31 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:32:31 user nova-compute[72863]: </disk>
Aug 15 13:32:31 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:32:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully detached device vdb from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the persistent domain config.
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.compute.manager [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.compute.manager [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] No waiting events found dispatching network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:31 user nova-compute[72863]: WARNING nova.compute.manager [req-e1cb9b51-0441-4d78-8968-073f5948eb5a req-dc5090ee-2a5f-4ccf-8dab-b237c5747c19 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received unexpected event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 for instance with vm_state building and task_state spawning.
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:31 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5074cc11-7a7f-42b8-bbb2-734bde66de58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff9aee1-ab08-424b-a2a4-fe1bdcd7bdea]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:31 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:31 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:31 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c331bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7837fcd3-059f-496e-9a3d-2adfca2de201]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d6c29-46f4-4e72-9d20-b7dc2a37ba9a]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[264ef784-5c6c-4555-aa5d-1a482911b880]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3f17c-565c-4f47-b7f5-b1b2ea1635b7]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a3d00-0a5e-4c70-8f31-1add4a6619d2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eac172-a413-4a79-9400-744a38e6c2b9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]
Aug 15 13:32:31 user nova-compute[72863]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:31 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48e492-34bd-4435-bbc5-9bc58b651532]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== disconnect_volume: return (345ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING nova.compute.manager [req-03dcca9a-4e2e-4796-9a1b-960b3646c374 req-57d84bd1-bf48-4ebb-8307-fbe494410a0c service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance destroyed successfully.
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-ServerActionsTestOtherA-server-1888390326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec0c786-08, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:32 user nova-compute[72863]: INFO os_vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08')
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2a83d-374f-4ae8-8b6d-20670f103f73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc02df1-400c-42ba-a275-dd8c08b11a2d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:32 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:32 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:32 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:32 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:32 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:32 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c3a2830>, {}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Disconnecting from: [] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== disconnect_volume: return (54ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:32:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Deleting instance files /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35_del
Aug 15 13:32:32 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Deletion of /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35_del complete
Aug 15 13:32:32 user nova-compute[72863]: INFO nova.virt.block_device [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Booting with volume fc498af9-1027-4d0f-b25e-2d6cf3c99705 at /dev/vdb
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.utils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8910580c-bae1-435d-a5d0-017714b0f5e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d926833-70f8-4b0e-9ffe-7b6948ede351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670944a-5dd3-40f5-8c08-289c4b6b71c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccaeda9-69ce-4e0e-96df-28150efdfc1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:32 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ffee15-a25a-49db-941f-7a78294988c0]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG os_brick.utils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating existing volume attachment record: 5719dc5b-967f-477a-aa27-76ed6a2aa640 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:32 user nova-compute[72863]: INFO nova.compute.manager [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Terminating instance
Aug 15 13:32:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106353.2769387, 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] VM Resumed (Lifecycle Event)
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Instance spawned successfully.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106353.2772827, 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] VM Started (Lifecycle Event)
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] No waiting events found dispatching network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:33 user nova-compute[72863]: WARNING nova.compute.manager [req-06067458-0f42-41d4-a422-cd061655ad37 req-dd7fdf1e-20db-40f5-aa02-3c54a952430c service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received unexpected event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 for instance with vm_state building and task_state spawning.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Took 16.57 seconds to build instance.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-04c4f929-f166-4b11-b9a6-ad483df8075d tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.678s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Instance destroyed successfully.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'resources' on Instance uuid deaee06a-0a48-45c7-b6d3-060b1778bf11 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451485257',display_name='tempest-AttachVolumeNegativeTest-server-451485257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451485257',id=25,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZb1/UiFRozb8uWgqS7HXBh5ZvXcQqjHqcn68tiATKmu/UVC7Sdq+AiaHAmiM0DdVgQd8Bfe9xKaJpP7ctqG4WkBMQj1VY2jixNCsANEhRRvJh9wEQPShxw25uahZKVQ==',key_name='tempest-keypair-1713708574',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-eqxjzx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=deaee06a-0a48-45c7-b6d3-060b1778bf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "address": "fa:16:3e:d9:98:15", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35aeaef8-bf", "ovs_interfaceid": "35aeaef8-bfd4-4620-8b30-26d103f2510c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG os_vif [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35aeaef8-bf, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:33 user nova-compute[72863]: INFO os_vif [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:98:15,bridge_name='br-int',has_traffic_filtering=True,id=35aeaef8-bfd4-4620-8b30-26d103f2510c,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35aeaef8-bf')
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Deleting instance files /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11_del
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Deletion of /opt/stack/data/nova/instances/deaee06a-0a48-45c7-b6d3-060b1778bf11_del complete
Aug 15 13:32:33 user nova-compute[72863]: INFO nova.compute.manager [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 13:32:33 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:32:33 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-unplugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] No waiting events found dispatching network-vif-unplugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-unplugged-35aeaef8-bfd4-4620-8b30-26d103f2510c for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Acquiring lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] No waiting events found dispatching network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:34 user nova-compute[72863]: WARNING nova.compute.manager [req-808cd89d-aeaf-4850-85de-b0bdeaec24e9 req-133e8153-56d4-4529-b6d2-8349afb96f8a service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received unexpected event network-vif-plugged-35aeaef8-bfd4-4620-8b30-26d103f2510c for instance with vm_state active and task_state deleting.
Aug 15 13:32:34 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:34 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Took 1.01 seconds to deallocate network for instance.
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:35 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Deleted allocations for instance deaee06a-0a48-45c7-b6d3-060b1778bf11
Aug 15 13:32:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-02ba0506-7368-47b7-8502-509ebe8dc980 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "deaee06a-0a48-45c7-b6d3-060b1778bf11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:35 user nova-compute[72863]: INFO nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Rebuilding instance
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-changed-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Refreshing instance network info cache due to event network-changed-99f3c102-8d72-48ae-a59a-8bea7f581c01. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] Acquiring lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] Acquired lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Refreshing network info cache for port 99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'pci_requests' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'pci_devices' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'resources' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'migration_context' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72863) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.network.neutron [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updated VIF entry in instance network info cache for port 99f3c102-8d72-48ae-a59a-8bea7f581c01. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.network.neutron [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating instance_info_cache with network_info: [{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cab50ed9-253d-4da3-a6e0-f1fb7238b264 req-c15bd3da-08c0-4315-ad3a-d880bf788cfe service nova] Releasing lock "refresh_cache-ba59f9b3-1f58-40f7-a9a3-a768abf0570d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Received event network-vif-deleted-35aeaef8-bfd4-4620-8b30-26d103f2510c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:36 user nova-compute[72863]: WARNING nova.compute.manager [req-2549223e-1c26-4f2b-a2d3-afc7d4b7415f req-d7a95868-3fbc-4511-9de2-8904afbd0e0f service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance destroyed successfully.
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106341.4165292, 36996814-2797-4261-80dd-59171815aef0 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:36 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 36996814-2797-4261-80dd-59171815aef0] VM Stopped (Lifecycle Event)
Aug 15 13:32:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance destroyed successfully.
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-707763085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f3c102-8d, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-526c5e00-001f-45cc-bb93-a1efe597b315 None None] [instance: 36996814-2797-4261-80dd-59171815aef0] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:36 user nova-compute[72863]: INFO os_vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d')
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed41502e-3180-4700-8a6c-08408ae562c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c82cf63-a41e-4c29-9439-2dd8ed81a762]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:36 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:36 user nova-compute[72863]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c2c3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b889b-8ef4-4f60-ae28-bd7c37103a8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8901fe-efa0-4c3c-bf88-81085c93148a]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3819a0f-e53c-4735-9bc2-c305e36db06b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68153b4e-bb6b-43f2-ae65-0c4fed2de33b]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6bd59511', '/dev/disk/by-id/scsi-23830323936366537', '/dev/disk/by-id/scsi-1SCST_BIO6bd59511-802966e7c095a521') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b764d-dd4e-49cc-99cb-1980850f52ef]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968145d-5118-42cc-9548-93b6508cf4bc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[244634b2-8a54-44ff-aa6a-12ebc14f074d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]
Aug 15 13:32:36 user nova-compute[72863]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e7eca-093e-489b-81e7-09f12b6f1bfd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== disconnect_volume: return (313ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:32:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deleting instance files /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d_del
Aug 15 13:32:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deletion of /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d_del complete
Aug 15 13:32:36 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d could not be found.
Aug 15 13:32:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[567fe91a-399f-4a71-bf7e-23e3adb26eb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbc4bdb-5d73-441b-96b5-598b369b6fef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:37 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:37 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff530860a60>, {}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Disconnecting from: [] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== disconnect_volume: return (55ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Preparing to wait for external event volume-reimaged-02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c {{(pid=72863) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No event matching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 in dict_keys([('volume-reimaged', '02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c')]) {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 15 13:32:38 user nova-compute[72863]: WARNING nova.compute.manager [req-7c85100a-22b0-4e3e-8e30-6f75a234825c req-8d3704fe-61b1-4d80-bd6f-8f1ff435d777 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state active and task_state rebuilding.
Aug 15 13:32:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'flavor' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-changed-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing instance network info cache due to event network-changed-f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing network info cache for port f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:40 user nova-compute[72863]: INFO nova.compute.manager [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Attaching volume f71a2a31-755b-42f6-8597-460e62faa878 to /dev/vdb
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.utils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bfbd1d-7b1e-440f-8db6-c07773155885]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb5ecb-6801-49dc-83e7-d49be2eeb980]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc70007a-2452-4b5e-afa6-421c8f48afe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ff156-56a3-42aa-a263-c48dadfe8aa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:40 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[579273b6-96b5-4a6a-88f0-f26bc32f43e6]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG os_brick.utils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating existing volume attachment record: 89656a56-7774-4c1c-a326-a0e9690a753e {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updated VIF entry in instance network info cache for port f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a15bcf78-183b-4984-b5ee-031dda07e82c req-47355792-84c0-4e9a-b251-2cd35e6e3242 service nova] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:41 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106346.0357845, 86c46771-bc19-4440-9ed1-d713a003b231 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:41 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] VM Stopped (Lifecycle Event)
Aug 15 13:32:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-744f8c6b-8a2a-402d-9eee-c066b5a065d9 None None] [instance: 86c46771-bc19-4440-9ed1-d713a003b231] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:42 user nova-compute[72863]: INFO nova.compute.manager [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] instance snapshotting
Aug 15 13:32:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Beginning live snapshot process
Aug 15 13:32:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc.delta 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc.delta 1073741824" returned: 0 in 0.050s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 13:32:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:32:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:32:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 13:32:44 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:32:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc.delta /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc.delta /opt/stack/data/nova/instances/snapshots/tmperldqxwl/3bde6dbfe2314a15b73ab39b16ff9acc" returned: 0 in 0.256s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Snapshot extracted, beginning image upload
Aug 15 13:32:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:32:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Creating image(s)
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk 1073741824" returned: 0 in 0.051s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106351.0462365, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:46 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Stopped (Lifecycle Event)
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ac89544c-ea21-46cf-a764-40db6743e95a None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Cannot resize image /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Ensure instance console log exists: /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start _get_guest_xml network_info=[{"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5719dc5b-967f-477a-aa27-76ed6a2aa640', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '246b401a-83c6-40d0-8f30-95af5cbebc35', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc498af9-1027-4d0f-b25e-2d6cf3c99705', 'serial': 'fc498af9-1027-4d0f-b25e-2d6cf3c99705'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:32:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 13:32:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 13:32:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'vcpu_model' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:46 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d227c798-9ce4-4c45-a6b1-648b15729b68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:32:46 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e08129-61d0-4e54-8e42-8cef9215620f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705] added
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd138f-63f9-4544-afe2-0ce7abf33716]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c6d8a-f272-4e3e-aa4f-1fac761a76a4]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCzqpOLi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCzqpOLi" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5280dcd7-59e7-4ee7-bfdb-430fcb6260b1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCzqpOLi'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa44e5-86cf-40cb-898f-9a25bc19f304]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee942855-ff88-46c8-87cf-19fb6bffc21c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f525b-084d-49f5-83f8-03bf2a2e5ab9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]
Aug 15 13:32:46 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959bd27-003b-468d-8600-e81223d3f72b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148ceb8-6b75-4b9f-b830-331fef67c90b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:46 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c826e95-02b5-4785-aac8-82e4ad159670]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Snapshot image upload complete
Aug 15 13:32:47 user nova-compute[72863]: INFO nova.compute.manager [None req-971049ec-197e-4737-af8e-189d04ecf5b1 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Took 5.07 seconds to snapshot the instance on the hypervisor.
Aug 15 13:32:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23133333936366531', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133333936366531', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-ServerActionsTestOtherA-server-1888390326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:32:47 user nova-compute[72863]:   <uuid>246b401a-83c6-40d0-8f30-95af5cbebc35</uuid>
Aug 15 13:32:47 user nova-compute[72863]:   <name>instance-0000001a</name>
Aug 15 13:32:47 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:32:47 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:32:47 user nova-compute[72863]:   <metadata>
Aug 15 13:32:47 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:32:47 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherA-server-1888390326</nova:name>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:32:46</nova:creationTime>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:32:47 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:32:47 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:owner>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:user uuid="d885a5f78b6e4c3c993fee958bee7cd0">tempest-ServerActionsTestOtherA-278685911-project-member</nova:user>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:project uuid="2d8a87964e7845cba898b18f2d5021ec">tempest-ServerActionsTestOtherA-278685911</nova:project>
Aug 15 13:32:47 user nova-compute[72863]:       </nova:owner>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:32:47 user nova-compute[72863]:       <nova:ports>
Aug 15 13:32:47 user nova-compute[72863]:         <nova:port uuid="1ec0c786-08d0-44f6-8c5d-4e4fb3665d79">
Aug 15 13:32:47 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:32:47 user nova-compute[72863]:         </nova:port>
Aug 15 13:32:47 user nova-compute[72863]:       </nova:ports>
Aug 15 13:32:47 user nova-compute[72863]:     </nova:instance>
Aug 15 13:32:47 user nova-compute[72863]:   </metadata>
Aug 15 13:32:47 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:32:47 user nova-compute[72863]:     <system>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="serial">246b401a-83c6-40d0-8f30-95af5cbebc35</entry>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="uuid">246b401a-83c6-40d0-8f30-95af5cbebc35</entry>
Aug 15 13:32:47 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:32:47 user nova-compute[72863]:     </system>
Aug 15 13:32:47 user nova-compute[72863]:   </sysinfo>
Aug 15 13:32:47 user nova-compute[72863]:   <os>
Aug 15 13:32:47 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:32:47 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:32:47 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:32:47 user nova-compute[72863]:   </os>
Aug 15 13:32:47 user nova-compute[72863]:   <features>
Aug 15 13:32:47 user nova-compute[72863]:     <acpi/>
Aug 15 13:32:47 user nova-compute[72863]:     <apic/>
Aug 15 13:32:47 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:32:47 user nova-compute[72863]:   </features>
Aug 15 13:32:47 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:32:47 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:32:47 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:32:47 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:32:47 user nova-compute[72863]:   </clock>
Aug 15 13:32:47 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:32:47 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:32:47 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:32:47 user nova-compute[72863]:   </cpu>
Aug 15 13:32:47 user nova-compute[72863]:   <devices>
Aug 15 13:32:47 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:32:47 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:32:47 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk"/>
Aug 15 13:32:47 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:32:47 user nova-compute[72863]:     </disk>
Aug 15 13:32:47 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:32:47 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:32:47 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:32:47 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:32:47 user nova-compute[72863]:       <serial>fc498af9-1027-4d0f-b25e-2d6cf3c99705</serial>
Aug 15 13:32:47 user nova-compute[72863]:     </disk>
Aug 15 13:32:47 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:32:47 user nova-compute[72863]:       <mac address="fa:16:3e:ce:b8:7e"/>
Aug 15 13:32:47 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:32:47 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:32:47 user nova-compute[72863]:       <target dev="tap1ec0c786-08"/>
Aug 15 13:32:47 user nova-compute[72863]:     </interface>
Aug 15 13:32:47 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:32:47 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/console.log" append="off"/>
Aug 15 13:32:47 user nova-compute[72863]:     </serial>
Aug 15 13:32:47 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:32:47 user nova-compute[72863]:     <video>
Aug 15 13:32:47 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:32:47 user nova-compute[72863]:     </video>
Aug 15 13:32:47 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:32:47 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:32:47 user nova-compute[72863]:     </rng>
Aug 15 13:32:47 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:32:47 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:32:47 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:32:47 user nova-compute[72863]:     </memballoon>
Aug 15 13:32:47 user nova-compute[72863]:   </devices>
Aug 15 13:32:47 user nova-compute[72863]: </domain>
Aug 15 13:32:47 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-ServerActionsTestOtherA-server-1888390326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG os_vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec0c786-08, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec0c786-08, col_values=(('external_ids', {'iface-id': '1ec0c786-08d0-44f6-8c5d-4e4fb3665d79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:b8:7e', 'vm-uuid': '246b401a-83c6-40d0-8f30-95af5cbebc35'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:48 user nova-compute[72863]: INFO os_vif [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08')
Aug 15 13:32:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:ce:b8:7e, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:32:48 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106353.6312535, deaee06a-0a48-45c7-b6d3-060b1778bf11 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:48 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] VM Stopped (Lifecycle Event)
Aug 15 13:32:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3dc164a8-7f58-4463-881b-a84fd66982e6 None None] [instance: deaee06a-0a48-45c7-b6d3-060b1778bf11] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:49 user nova-compute[72863]: WARNING nova.compute.manager [req-32b35add-e6de-43d2-a30c-17e10fff8bd6 req-58072522-92d4-4179-807f-4beab2069097 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 13:32:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:50 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:50 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:50 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b33d9-c446-492f-a89c-9e196c633424]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:32:50 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fbf6aa-f20c-46c2-a92d-0035c981c94b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[762bc171-d95a-46da-8cd0-75761601c667]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e385597-1dfe-4ea5-b37d-8d0978737bc1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ed7bf-e0c3-4986-892d-b54171cb97f8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtuRhwFc'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7e168a-0b57-4e14-a31d-ccaed283931a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f3b7d-7d59-43f8-8da4-b3e6131ed3ef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0851e6b-ce6d-4217-9144-41cd42b8ba78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:32:50 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[229ec209-dc5d-4b56-bc6c-eb2a2113be48]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5462b89-e751-4d87-93cd-abbd94b30bef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:32:50 user nova-compute[72863]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:32:50 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf2708d-402e-4d68-8d64-695305caefc1]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:32:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106356.4023864, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Stopped (Lifecycle Event)
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b2d68d66-69d6-4e6a-96a9-b6ffc3a6026f None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106371.442559, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Resumed (Lifecycle Event)
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance spawned successfully.
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106371.4435759, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Started (Lifecycle Event)
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:32:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:51 user nova-compute[72863]: WARNING nova.compute.manager [req-eaa93646-6f79-4b8a-a89c-ee47e333dd2e req-c6851071-32f1-42b8-8ede-04d01ff343d3 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72863) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fc8cd27e-a89f-43bd-881d-892e955ad69f tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'flavor' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:32:51 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:32:51 user nova-compute[72863]:   <source dev="/dev/sdf"/>
Aug 15 13:32:51 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:32:51 user nova-compute[72863]:   <serial>f71a2a31-755b-42f6-8597-460e62faa878</serial>
Aug 15 13:32:51 user nova-compute[72863]: </disk>
Aug 15 13:32:51 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:32:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:32:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No VIF found with MAC fa:16:3e:ca:73:dd, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:32:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3c4f5f44-69b8-4caa-b7da-015a740a421d tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.420s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Stashing vm_state: active {{(pid=72863) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'pci_requests' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:32:55 user nova-compute[72863]: INFO nova.compute.claims [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Claim successful on node user
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'resources' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'pci_devices' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:32:55 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating resource usage from migration 40616171-8c65-496d-b5e2-e45f29f9c7b0
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.597s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:55 user nova-compute[72863]: INFO nova.compute.manager [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Migrating
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:55 user nova-compute[72863]: INFO nova.compute.rpcapi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Starting migrate_disk_and_power_off {{(pid=72863) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-0411c6f9-4a05-4560-aa1d-487be58af66c req-dd2c3fc8-ea0f-4e35-a84d-4b9fd0b0ba19 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event volume-reimaged-02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0411c6f9-4a05-4560-aa1d-487be58af66c req-dd2c3fc8-ea0f-4e35-a84d-4b9fd0b0ba19 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0411c6f9-4a05-4560-aa1d-487be58af66c req-dd2c3fc8-ea0f-4e35-a84d-4b9fd0b0ba19 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0411c6f9-4a05-4560-aa1d-487be58af66c req-dd2c3fc8-ea0f-4e35-a84d-4b9fd0b0ba19 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-0411c6f9-4a05-4560-aa1d-487be58af66c req-dd2c3fc8-ea0f-4e35-a84d-4b9fd0b0ba19 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Processing event volume-reimaged-02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:32:56 user nova-compute[72863]: INFO nova.virt.block_device [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Booting with volume 02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c at /dev/vda
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:56 user nova-compute[72863]: WARNING nova.compute.manager [req-44dc0d85-1aa2-48a9-b688-a2daec178cc5 req-f23495de-200a-4f70-8842-e1c5d6476ec9 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state active and task_state resize_migrating.
Aug 15 13:32:56 user nova-compute[72863]: DEBUG os_brick.utils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf536e-839e-4d6a-a520-c102b629d972]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8841b48e-1fec-4080-9e08-11688b6b3b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0740fe-770c-4522-b626-fc068d39381b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a5d889-7bfc-4297-9f73-fbbc9f9b9155]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:32:57 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea1e1a-19e0-4920-9bdc-3f969119ab4a]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating existing volume attachment record: a2d9f9e5-c779-4168-82d4-28db25effdca {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance destroyed successfully.
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa249e220-f1, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:32:57 user nova-compute[72863]: INFO os_vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:32:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97419801-4c0a-46c9-9f38-d9df4b87b431]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b477192-3a54-48f0-94e1-ab4e2a84f9bf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:32:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff524302dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'): ({'sdf'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Removing single pathed devices sdf {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c2ce8-e592-429e-8808-c47805facbe8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eea711-1713-4899-baea-6726acee2fc4]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flushing IO for device /dev/sdf {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50d31e4-2325-44a6-a9f5-dee58807ac77]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1aa1f6-6c47-48b1-8ae4-d1bbe8503fe6]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd4fc2-e853-41cd-9521-57292fd0e242]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2173a-4fd1-4f16-9e6f-252c4684c16f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:32:57 user nova-compute[72863]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:32:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f5dc7-c2ed-4376-9275-9810037d185f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== disconnect_volume: return (374ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_resize/disk /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "cp -r /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_resize/disk /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk" returned: 0 in 0.363s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_resize/disk.info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk.info {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:32:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "cp -r /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_resize/disk.info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk.info" returned: 0 in 0.037s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:32:59 user nova-compute[72863]: WARNING nova.compute.manager [req-c9592a1b-d6c2-4e89-ae79-70ce51507f11 req-1adde061-b72c-46eb-831b-999d7be47e1d service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state active and task_state resize_migrating.
Aug 15 13:32:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Port a249e220-f1eb-4dee-9aaf-f12953a48bbd binding to destination host user is already ACTIVE {{(pid=72863) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:32:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.utils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634a438-cfe7-41c6-91df-f8d55833c395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f66ad-de8f-4923-a6fc-6cf6bc0ae876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61bdef-fff8-435c-b65c-1d3fa3bfebe1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bde747-555d-4cfb-a929-2de510021b71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:33:00 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:33:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ee146f-e405-4d93-96b0-ff6ad7d39242]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:33:00 user nova-compute[72863]: DEBUG os_brick.utils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:33:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:33:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Creating image(s)
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start _get_guest_xml network_info=[{"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a2d9f9e5-c779-4168-82d4-28db25effdca', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba59f9b3-1f58-40f7-a9a3-a768abf0570d', 'attached_at': '', 'detached_at': '', 'volume_id': '02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c', 'serial': '02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:33:07 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 13:33:07 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:33:07 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:07 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:07 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[840af759-d414-4ece-b138-eba3e436eebf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:33:07 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1043b0c-86dd-4c13-b6d1-d3996b7c8880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c] added
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f39b9-2533-4425-8d97-2c1619495555]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2c3e7-c5b8-4f81-bab3-d2beb1c6d5f9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyaEdtfv {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kyaEdtfv" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1b138-b966-41cf-a1bf-4545e3803633]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kyaEdtfv'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a24d4a8-6656-4b90-a006-caab2bdfa51c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db6b83-e26e-4e90-94cc-4a1c1d820fcc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1407e8dd-414f-4be4-9206-fcb6906261f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]
Aug 15 13:33:07 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a6ff0-f680-4920-a191-90bcd4f0cacc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac811f-b3b5-4cdc-91af-71fa243bd7e3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:07 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289e2a1-d029-40e1-b767-9cf69b41a222]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:33:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23830323936366537', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830323936366537', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-707763085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:33:08 user nova-compute[72863]:   <uuid>ba59f9b3-1f58-40f7-a9a3-a768abf0570d</uuid>
Aug 15 13:33:08 user nova-compute[72863]:   <name>instance-0000001c</name>
Aug 15 13:33:08 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:33:08 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:33:08 user nova-compute[72863]:   <metadata>
Aug 15 13:33:08 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:33:08 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:33:08 user nova-compute[72863]:       <nova:name>tempest-ServerActionsV293TestJSON-server-707763085</nova:name>
Aug 15 13:33:08 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:33:07</nova:creationTime>
Aug 15 13:33:08 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:33:08 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:33:08 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:33:08 user nova-compute[72863]:       <nova:owner>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:user uuid="7b3145c37cde4968bafdb06a74599170">tempest-ServerActionsV293TestJSON-1961177819-project-member</nova:user>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:project uuid="48481eca81a74f65b273919037f1677c">tempest-ServerActionsV293TestJSON-1961177819</nova:project>
Aug 15 13:33:08 user nova-compute[72863]:       </nova:owner>
Aug 15 13:33:08 user nova-compute[72863]:       <nova:ports>
Aug 15 13:33:08 user nova-compute[72863]:         <nova:port uuid="99f3c102-8d72-48ae-a59a-8bea7f581c01">
Aug 15 13:33:08 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 13:33:08 user nova-compute[72863]:         </nova:port>
Aug 15 13:33:08 user nova-compute[72863]:       </nova:ports>
Aug 15 13:33:08 user nova-compute[72863]:     </nova:instance>
Aug 15 13:33:08 user nova-compute[72863]:   </metadata>
Aug 15 13:33:08 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:33:08 user nova-compute[72863]:     <system>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="serial">ba59f9b3-1f58-40f7-a9a3-a768abf0570d</entry>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="uuid">ba59f9b3-1f58-40f7-a9a3-a768abf0570d</entry>
Aug 15 13:33:08 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:33:08 user nova-compute[72863]:     </system>
Aug 15 13:33:08 user nova-compute[72863]:   </sysinfo>
Aug 15 13:33:08 user nova-compute[72863]:   <os>
Aug 15 13:33:08 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:33:08 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:33:08 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:33:08 user nova-compute[72863]:   </os>
Aug 15 13:33:08 user nova-compute[72863]:   <features>
Aug 15 13:33:08 user nova-compute[72863]:     <acpi/>
Aug 15 13:33:08 user nova-compute[72863]:     <apic/>
Aug 15 13:33:08 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:33:08 user nova-compute[72863]:   </features>
Aug 15 13:33:08 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:33:08 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:33:08 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:33:08 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:33:08 user nova-compute[72863]:   </clock>
Aug 15 13:33:08 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:33:08 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:33:08 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:33:08 user nova-compute[72863]:   </cpu>
Aug 15 13:33:08 user nova-compute[72863]:   <devices>
Aug 15 13:33:08 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:33:08 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:33:08 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:33:08 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:33:08 user nova-compute[72863]:       <serial>02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c</serial>
Aug 15 13:33:08 user nova-compute[72863]:     </disk>
Aug 15 13:33:08 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:33:08 user nova-compute[72863]:       <mac address="fa:16:3e:e7:ef:42"/>
Aug 15 13:33:08 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:08 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:33:08 user nova-compute[72863]:       <target dev="tap99f3c102-8d"/>
Aug 15 13:33:08 user nova-compute[72863]:     </interface>
Aug 15 13:33:08 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:33:08 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d/console.log" append="off"/>
Aug 15 13:33:08 user nova-compute[72863]:     </serial>
Aug 15 13:33:08 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:33:08 user nova-compute[72863]:     <video>
Aug 15 13:33:08 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:08 user nova-compute[72863]:     </video>
Aug 15 13:33:08 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:33:08 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:33:08 user nova-compute[72863]:     </rng>
Aug 15 13:33:08 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:33:08 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:33:08 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:33:08 user nova-compute[72863]:     </memballoon>
Aug 15 13:33:08 user nova-compute[72863]:   </devices>
Aug 15 13:33:08 user nova-compute[72863]: </domain>
Aug 15 13:33:08 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-707763085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG os_vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f3c102-8d, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99f3c102-8d, col_values=(('external_ids', {'iface-id': '99f3c102-8d72-48ae-a59a-8bea7f581c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ef:42', 'vm-uuid': 'ba59f9b3-1f58-40f7-a9a3-a768abf0570d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:08 user nova-compute[72863]: INFO os_vif [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d')
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] No VIF found with MAC fa:16:3e:e7:ef:42, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:08 user nova-compute[72863]: INFO nova.compute.manager [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Unrescuing
Aug 15 13:33:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquired lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:08 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [{"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Releasing lock "refresh_cache-5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'flavor' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:09 user nova-compute[72863]: WARNING nova.compute.manager [req-6c6206f5-c4a1-4076-9abd-68a940106871 req-1b489222-de48-4aa9-8ccc-7abc2a1e0162 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:33:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Starting finish_migration {{(pid=72863) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:33:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Creating image(s)
Aug 15 13:33:10 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'trusted_certs' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk. size=21474836480 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance destroyed successfully.
Aug 15 13:33:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk 21474836480 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk 21474836480" returned: 0 in 0.061s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Ensure instance console log exists: /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start _get_guest_xml network_info=[{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '46f75693-f9c1-431b-aeb7-f2b8f3a91d7d', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '314a7b77-4fbc-4184-add3-7f1e44aa7b0f', 'attached_at': '2023-08-15T13:33:10.000000', 'detached_at': '', 'volume_id': 'f71a2a31-755b-42f6-8597-460e62faa878', 'serial': 'f71a2a31-755b-42f6-8597-460e62faa878'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:11 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'vcpu_model' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:11 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f173f-5704-436f-920c-02ed4e3dca69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:33:11 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e54afc-f5fe-4642-baed-dc69db991322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de9695b-f9d8-4f94-8f70-af8d4fa01b72]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacaee0c-a13e-46cb-a094-920a1a797da0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb98e9-bb37-4343-ae08-21d2f64c1128]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtuRhwFc'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcaa51e-0bc1-4cee-bad3-db1a88cb8a76]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbcb1d8-5fd4-405c-802e-7bfd95cb280c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f33454e-2405-4687-bad1-b9f68e3c7474]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:33:11 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87235735-080b-4861-b0cc-22cf16ba8650]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b8b30-02f7-449b-a31c-2d4d71aab19c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:11 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee049135-fa50-4c22-9acf-8ba6b218163e]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:11 user nova-compute[72863]: WARNING nova.compute.manager [req-7ba059d9-1e04-4d60-97a9-a05696ad3bb9 req-9bdd8fb9-9a18-4315-9d36-015143a89801 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106377.3441188, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Stopped (Lifecycle Event)
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-49273089-8407-49df-b741-69d1e86a2cd0 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-49273089-8407-49df-b741-69d1e86a2cd0 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [None req-49273089-8407-49df-b741-69d1e86a2cd0 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 13:33:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:33:12 user nova-compute[72863]:   <uuid>314a7b77-4fbc-4184-add3-7f1e44aa7b0f</uuid>
Aug 15 13:33:12 user nova-compute[72863]:   <name>instance-00000016</name>
Aug 15 13:33:12 user nova-compute[72863]:   <memory>2097152</memory>
Aug 15 13:33:12 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:33:12 user nova-compute[72863]:   <metadata>
Aug 15 13:33:12 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:33:12 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherB-server-1841832683</nova:name>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:33:11</nova:creationTime>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:flavor name="m1.small">
Aug 15 13:33:12 user nova-compute[72863]:         <nova:memory>2048</nova:memory>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:disk>20</nova:disk>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:33:12 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:owner>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:user uuid="5c38ea4a412d4cb8ad2e8b7f89c3d5c4">tempest-ServerActionsTestOtherB-852730704-project-member</nova:user>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:project uuid="6cfea57273354f118f2cdc6734d0d796">tempest-ServerActionsTestOtherB-852730704</nova:project>
Aug 15 13:33:12 user nova-compute[72863]:       </nova:owner>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:33:12 user nova-compute[72863]:       <nova:ports>
Aug 15 13:33:12 user nova-compute[72863]:         <nova:port uuid="a249e220-f1eb-4dee-9aaf-f12953a48bbd">
Aug 15 13:33:12 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 13:33:12 user nova-compute[72863]:         </nova:port>
Aug 15 13:33:12 user nova-compute[72863]:       </nova:ports>
Aug 15 13:33:12 user nova-compute[72863]:     </nova:instance>
Aug 15 13:33:12 user nova-compute[72863]:   </metadata>
Aug 15 13:33:12 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:33:12 user nova-compute[72863]:     <system>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="serial">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="uuid">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:33:12 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:33:12 user nova-compute[72863]:     </system>
Aug 15 13:33:12 user nova-compute[72863]:   </sysinfo>
Aug 15 13:33:12 user nova-compute[72863]:   <os>
Aug 15 13:33:12 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:33:12 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:33:12 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:33:12 user nova-compute[72863]:   </os>
Aug 15 13:33:12 user nova-compute[72863]:   <features>
Aug 15 13:33:12 user nova-compute[72863]:     <acpi/>
Aug 15 13:33:12 user nova-compute[72863]:     <apic/>
Aug 15 13:33:12 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:33:12 user nova-compute[72863]:   </features>
Aug 15 13:33:12 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:33:12 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:33:12 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:33:12 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:33:12 user nova-compute[72863]:   </clock>
Aug 15 13:33:12 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:33:12 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:33:12 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:33:12 user nova-compute[72863]:   </cpu>
Aug 15 13:33:12 user nova-compute[72863]:   <devices>
Aug 15 13:33:12 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:33:12 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:33:12 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk"/>
Aug 15 13:33:12 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:33:12 user nova-compute[72863]:     </disk>
Aug 15 13:33:12 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:33:12 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:33:12 user nova-compute[72863]:       <source dev="/dev/sdf"/>
Aug 15 13:33:12 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:33:12 user nova-compute[72863]:       <serial>f71a2a31-755b-42f6-8597-460e62faa878</serial>
Aug 15 13:33:12 user nova-compute[72863]:     </disk>
Aug 15 13:33:12 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:33:12 user nova-compute[72863]:       <mac address="fa:16:3e:ca:73:dd"/>
Aug 15 13:33:12 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:12 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:33:12 user nova-compute[72863]:       <target dev="tapa249e220-f1"/>
Aug 15 13:33:12 user nova-compute[72863]:     </interface>
Aug 15 13:33:12 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:33:12 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/console.log" append="off"/>
Aug 15 13:33:12 user nova-compute[72863]:     </serial>
Aug 15 13:33:12 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:33:12 user nova-compute[72863]:     <video>
Aug 15 13:33:12 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:12 user nova-compute[72863]:     </video>
Aug 15 13:33:12 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:33:12 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:33:12 user nova-compute[72863]:     </rng>
Aug 15 13:33:12 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:33:12 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:33:12 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:33:12 user nova-compute[72863]:     </memballoon>
Aug 15 13:33:12 user nova-compute[72863]:   </devices>
Aug 15 13:33:12 user nova-compute[72863]: </domain>
Aug 15 13:33:12 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-801687522-network", "vif_mac": "fa:16:3e:ca:73:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG os_vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa249e220-f1, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa249e220-f1, col_values=(('external_ids', {'iface-id': 'a249e220-f1eb-4dee-9aaf-f12953a48bbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:73:dd', 'vm-uuid': '314a7b77-4fbc-4184-add3-7f1e44aa7b0f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:12 user nova-compute[72863]: INFO os_vif [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] No VIF found with MAC fa:16:3e:ca:73:dd, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106392.870993, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Resumed (Lifecycle Event)
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance spawned successfully.
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106392.87208, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Started (Lifecycle Event)
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:12 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 13:33:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72863) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0411c6f9-4a05-4560-aa1d-487be58af66c tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:14 user nova-compute[72863]: WARNING nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:14 user nova-compute[72863]: WARNING nova.compute.manager [req-b8f380b5-5882-443d-8963-f1babbac1da0 req-e5d69b9a-d3fa-4f83-8bdb-dd79de5bcb70 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:14 user nova-compute[72863]: WARNING nova.compute.manager [req-15636265-da68-4649-82d9-6ec209185880 req-a9a96fcc-86e9-4428-8acb-fb9b3f710bf0 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state active and task_state resize_finish.
Aug 15 13:33:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:15 user nova-compute[72863]: INFO nova.compute.manager [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Rescuing
Aug 15 13:33:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106395.4517891, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Resumed (Lifecycle Event)
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07a9bf20-91da-48a8-9a78-68bb9a5f4258 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106395.45323, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:15 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Started (Lifecycle Event)
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:16 user nova-compute[72863]: WARNING nova.compute.manager [req-83f0c703-9456-4b0c-81b3-58e6c38c7743 req-92404e2b-0bc6-4b20-af17-7308b0865a99 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state active and task_state rescuing.
Aug 15 13:33:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106396.3539264, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Resumed (Lifecycle Event)
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance running successfully.
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Failed to set time: agent not configured {{(pid=72863) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7586c000-3fff-4475-b6e8-2f683e8b09d3 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] finish_migration finished successfully. {{(pid=72863) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:16 user nova-compute[72863]: WARNING nova.compute.manager [req-b3c7dfb0-732b-429c-9d28-30fba3047551 req-74adeedc-56c3-43df-ad9e-1473deb5432f service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state active and task_state resize_finish.
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106396.3554945, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Started (Lifecycle Event)
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance destroyed successfully.
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Attempting rescue
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72863) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:33:16 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Creating image(s)
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.207s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue" returned: 0 in 0.051s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start _get_guest_xml network_info=[{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:ed:e0:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'numa_topology' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:16 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:16 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1057708234',display_name='tempest-ServerRescueNegativeTestJSON-server-1057708234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1057708234',id=19,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-jyhasptx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:28:37Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=eb797116-28dc-481b-af43-439920b4f269,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:ed:e0:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:ed:e0:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:33:17 user nova-compute[72863]:   <uuid>eb797116-28dc-481b-af43-439920b4f269</uuid>
Aug 15 13:33:17 user nova-compute[72863]:   <name>instance-00000013</name>
Aug 15 13:33:17 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:33:17 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:33:17 user nova-compute[72863]:   <metadata>
Aug 15 13:33:17 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:33:17 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1057708234</nova:name>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:33:16</nova:creationTime>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:33:17 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:33:17 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:owner>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:33:17 user nova-compute[72863]:       </nova:owner>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:33:17 user nova-compute[72863]:       <nova:ports>
Aug 15 13:33:17 user nova-compute[72863]:         <nova:port uuid="598a82a2-20af-48a4-9465-b83e9d9e6b70">
Aug 15 13:33:17 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 13:33:17 user nova-compute[72863]:         </nova:port>
Aug 15 13:33:17 user nova-compute[72863]:       </nova:ports>
Aug 15 13:33:17 user nova-compute[72863]:     </nova:instance>
Aug 15 13:33:17 user nova-compute[72863]:   </metadata>
Aug 15 13:33:17 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:33:17 user nova-compute[72863]:     <system>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="serial">eb797116-28dc-481b-af43-439920b4f269</entry>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="uuid">eb797116-28dc-481b-af43-439920b4f269</entry>
Aug 15 13:33:17 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:33:17 user nova-compute[72863]:     </system>
Aug 15 13:33:17 user nova-compute[72863]:   </sysinfo>
Aug 15 13:33:17 user nova-compute[72863]:   <os>
Aug 15 13:33:17 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:33:17 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:33:17 user nova-compute[72863]:   </os>
Aug 15 13:33:17 user nova-compute[72863]:   <features>
Aug 15 13:33:17 user nova-compute[72863]:     <acpi/>
Aug 15 13:33:17 user nova-compute[72863]:     <apic/>
Aug 15 13:33:17 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:33:17 user nova-compute[72863]:   </features>
Aug 15 13:33:17 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:33:17 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:33:17 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:33:17 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:33:17 user nova-compute[72863]:   </clock>
Aug 15 13:33:17 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:33:17 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:33:17 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:33:17 user nova-compute[72863]:   </cpu>
Aug 15 13:33:17 user nova-compute[72863]:   <devices>
Aug 15 13:33:17 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:33:17 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:33:17 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue"/>
Aug 15 13:33:17 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:33:17 user nova-compute[72863]:     </disk>
Aug 15 13:33:17 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:33:17 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:33:17 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk"/>
Aug 15 13:33:17 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:33:17 user nova-compute[72863]:     </disk>
Aug 15 13:33:17 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:33:17 user nova-compute[72863]:       <mac address="fa:16:3e:ed:e0:62"/>
Aug 15 13:33:17 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:17 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:33:17 user nova-compute[72863]:       <target dev="tap598a82a2-20"/>
Aug 15 13:33:17 user nova-compute[72863]:     </interface>
Aug 15 13:33:17 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:33:17 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/console.log" append="off"/>
Aug 15 13:33:17 user nova-compute[72863]:     </serial>
Aug 15 13:33:17 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:33:17 user nova-compute[72863]:     <video>
Aug 15 13:33:17 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:17 user nova-compute[72863]:     </video>
Aug 15 13:33:17 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:33:17 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:33:17 user nova-compute[72863]:     </rng>
Aug 15 13:33:17 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:33:17 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:33:17 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:33:17 user nova-compute[72863]:     </memballoon>
Aug 15 13:33:17 user nova-compute[72863]:   </devices>
Aug 15 13:33:17 user nova-compute[72863]: </domain>
Aug 15 13:33:17 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:33:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance destroyed successfully.
Aug 15 13:33:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:ed:e0:62, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:18 user nova-compute[72863]: WARNING nova.compute.manager [req-2a7b2ab4-f5a5-48dd-b88a-b6eb4735ff6a req-884aa5fc-fafd-48f7-b124-f23b4e4d9039 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state active and task_state rescuing.
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:33:20 user nova-compute[72863]: INFO nova.compute.claims [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Claim successful on node user
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:20 user nova-compute[72863]: WARNING nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state active and task_state rescuing.
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:20 user nova-compute[72863]: WARNING nova.compute.manager [req-5d39cbda-db00-4646-8064-bfa6c243bf56 req-dbc133f4-10c2-4d40-b5c8-a67e55ebbcc4 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state active and task_state rescuing.
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:33:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.policy [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acc0646305654477852de0c8bdebce90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '974e84d7fd49440bb0449944cc4ffa94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for eb797116-28dc-481b-af43-439920b4f269 due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106401.231354, eb797116-28dc-481b-af43-439920b4f269 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:21 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Resumed (Lifecycle Event)
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:33:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Creating image(s)
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "/opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "/opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5b1ef632-2cba-4b22-b1b6-e668ee4a8107 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:21 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106401.2327654, eb797116-28dc-481b-af43-439920b4f269 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:21 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Started (Lifecycle Event)
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.242s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk 1073741824" returned: 0 in 0.069s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-changed-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Refreshing instance network info cache due to event network-changed-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] Acquiring lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] Acquired lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:21 user nova-compute[72863]: DEBUG nova.network.neutron [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Refreshing network info cache for port 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Ignoring supplied device name: /dev/vdb
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Cannot resize image /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'migration_context' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Ensure instance console log exists: /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:22 user nova-compute[72863]: INFO nova.compute.manager [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Attaching volume 7376d7af-619e-444e-b987-d5309f0addd0 to /dev/vdb
Aug 15 13:33:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.utils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69f13e-ff9a-4ee7-8dbc-f52482b54a8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updated VIF entry in instance network info cache for port 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating instance_info_cache with network_info: [{"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d2837-f1a9-47cb-a054-c3d62530f85b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d082d55c-1bc1-4e0c-a3cb-b27a6bd6cbe5 req-3b0b71c1-03c4-4b40-92c2-ffda32b1369b service nova] Releasing lock "refresh_cache-dc2d8463-dd59-47ca-8142-28bd790cf247" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc94627-231e-4789-99ca-4dddf85ec7aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Successfully created port: 617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a785f-ffe4-4617-b272-227531a19e3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:33:22 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:33:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f68af3-f684-4a3e-8949-0c1d8c174a65]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG os_brick.utils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:33:22 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating existing volume attachment record: 080a993e-0afd-475c-8562-950d127ff5cf {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Successfully updated port: 617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquired lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-changed-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Refreshing instance network info cache due to event network-changed-617c3d83-7a55-40cb-ba1b-cee74c49cfcc. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] Acquiring lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:33:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating instance_info_cache with network_info: [{"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Releasing lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Instance network_info: |[{"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] Acquired lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Refreshing network info cache for port 617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Start _get_guest_xml network_info=[{"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:33:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-862584300',display_name='tempest-AttachVolumeTestJSON-server-862584300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-862584300',id=32,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XfP1wQl4J4eYKU0PQae6tySilcZRjqtqNamqDBCW/LepdC+F0N3Cn25KcyLTNnwXPBHj6Q0UisMuZwZX4TuGc9E3/FaV/QUlR8BYpCWVEXUhxMszWHpYBi0DuRVsCfQ==',key_name='tempest-keypair-344133341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-w7es447f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=0a6ea5f3-c240-4483-8aaa-2da3a772e634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:33:24 user nova-compute[72863]:   <uuid>0a6ea5f3-c240-4483-8aaa-2da3a772e634</uuid>
Aug 15 13:33:24 user nova-compute[72863]:   <name>instance-00000020</name>
Aug 15 13:33:24 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:33:24 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:33:24 user nova-compute[72863]:   <metadata>
Aug 15 13:33:24 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:33:24 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeTestJSON-server-862584300</nova:name>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:33:24</nova:creationTime>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:33:24 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:33:24 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:owner>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:user uuid="acc0646305654477852de0c8bdebce90">tempest-AttachVolumeTestJSON-1527183200-project-member</nova:user>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:project uuid="974e84d7fd49440bb0449944cc4ffa94">tempest-AttachVolumeTestJSON-1527183200</nova:project>
Aug 15 13:33:24 user nova-compute[72863]:       </nova:owner>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:33:24 user nova-compute[72863]:       <nova:ports>
Aug 15 13:33:24 user nova-compute[72863]:         <nova:port uuid="617c3d83-7a55-40cb-ba1b-cee74c49cfcc">
Aug 15 13:33:24 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:33:24 user nova-compute[72863]:         </nova:port>
Aug 15 13:33:24 user nova-compute[72863]:       </nova:ports>
Aug 15 13:33:24 user nova-compute[72863]:     </nova:instance>
Aug 15 13:33:24 user nova-compute[72863]:   </metadata>
Aug 15 13:33:24 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:33:24 user nova-compute[72863]:     <system>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="serial">0a6ea5f3-c240-4483-8aaa-2da3a772e634</entry>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="uuid">0a6ea5f3-c240-4483-8aaa-2da3a772e634</entry>
Aug 15 13:33:24 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:33:24 user nova-compute[72863]:     </system>
Aug 15 13:33:24 user nova-compute[72863]:   </sysinfo>
Aug 15 13:33:24 user nova-compute[72863]:   <os>
Aug 15 13:33:24 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:33:24 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:33:24 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:33:24 user nova-compute[72863]:   </os>
Aug 15 13:33:24 user nova-compute[72863]:   <features>
Aug 15 13:33:24 user nova-compute[72863]:     <acpi/>
Aug 15 13:33:24 user nova-compute[72863]:     <apic/>
Aug 15 13:33:24 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:33:24 user nova-compute[72863]:   </features>
Aug 15 13:33:24 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:33:24 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:33:24 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:33:24 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:33:24 user nova-compute[72863]:   </clock>
Aug 15 13:33:24 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:33:24 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:33:24 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:33:24 user nova-compute[72863]:   </cpu>
Aug 15 13:33:24 user nova-compute[72863]:   <devices>
Aug 15 13:33:24 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:33:24 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:33:24 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk"/>
Aug 15 13:33:24 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:33:24 user nova-compute[72863]:     </disk>
Aug 15 13:33:24 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:33:24 user nova-compute[72863]:       <mac address="fa:16:3e:65:88:fb"/>
Aug 15 13:33:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:24 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:33:24 user nova-compute[72863]:       <target dev="tap617c3d83-7a"/>
Aug 15 13:33:24 user nova-compute[72863]:     </interface>
Aug 15 13:33:24 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:33:24 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/console.log" append="off"/>
Aug 15 13:33:24 user nova-compute[72863]:     </serial>
Aug 15 13:33:24 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:33:24 user nova-compute[72863]:     <video>
Aug 15 13:33:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:24 user nova-compute[72863]:     </video>
Aug 15 13:33:24 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:33:24 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:33:24 user nova-compute[72863]:     </rng>
Aug 15 13:33:24 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:33:24 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:33:24 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:33:24 user nova-compute[72863]:     </memballoon>
Aug 15 13:33:24 user nova-compute[72863]:   </devices>
Aug 15 13:33:24 user nova-compute[72863]: </domain>
Aug 15 13:33:24 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-862584300',display_name='tempest-AttachVolumeTestJSON-server-862584300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-862584300',id=32,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XfP1wQl4J4eYKU0PQae6tySilcZRjqtqNamqDBCW/LepdC+F0N3Cn25KcyLTNnwXPBHj6Q0UisMuZwZX4TuGc9E3/FaV/QUlR8BYpCWVEXUhxMszWHpYBi0DuRVsCfQ==',key_name='tempest-keypair-344133341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-w7es447f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=0a6ea5f3-c240-4483-8aaa-2da3a772e634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG os_vif [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617c3d83-7a, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617c3d83-7a, col_values=(('external_ids', {'iface-id': '617c3d83-7a55-40cb-ba1b-cee74c49cfcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:88:fb', 'vm-uuid': '0a6ea5f3-c240-4483-8aaa-2da3a772e634'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:24 user nova-compute[72863]: INFO os_vif [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a')
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No VIF found with MAC fa:16:3e:65:88:fb, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updated VIF entry in instance network info cache for port 617c3d83-7a55-40cb-ba1b-cee74c49cfcc. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating instance_info_cache with network_info: [{"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-251b205a-5640-48ec-a9e2-fc5f77a535a7 req-f20a59e3-d8b1-4de1-82c0-eaed5d2e1e8b service nova] Releasing lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106408.729326, 0a6ea5f3-c240-4483-8aaa-2da3a772e634 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] VM Resumed (Lifecycle Event)
Aug 15 13:33:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] No waiting events found dispatching network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:29 user nova-compute[72863]: WARNING nova.compute.manager [req-366b5484-98ad-4c8a-85b7-1a8b4df7b2f4 req-69559ebb-5fae-4e26-9546-c0a8ef02033d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received unexpected event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc for instance with vm_state building and task_state spawning.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] No waiting events found dispatching network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:29 user nova-compute[72863]: WARNING nova.compute.manager [req-d2a4fadf-170b-4743-9661-c788f39b8c5d req-5819a2eb-c514-45ab-8ecb-94483a52fc1d service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received unexpected event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc for instance with vm_state building and task_state spawning.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7017MB free_disk=25.42657470703125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Instance spawned successfully.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106408.7300286, 0a6ea5f3-c240-4483-8aaa-2da3a772e634 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] VM Started (Lifecycle Event)
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Took 8.10 seconds to spawn the instance on the hypervisor.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Applying migration context for instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f as it has an incoming, in-progress migration 40616171-8c65-496d-b5e2-e45f29f9c7b0. Migration status is finished {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating resource usage from migration 40616171-8c65-496d-b5e2-e45f29f9c7b0
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance dc2d8463-dd59-47ca-8142-28bd790cf247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Migration 40616171-8c65-496d-b5e2-e45f29f9c7b0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:33:29 user nova-compute[72863]: INFO nova.compute.manager [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Took 9.40 seconds to build instance.
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d711289a-8c75-40fc-a55b-c0d6478b664f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-34c264a3-cbba-42cf-b8b2-f8309dec9ed7 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.519s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.921s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.726s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:33:30 user nova-compute[72863]: INFO nova.compute.claims [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Claim successful on node user
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:33:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.policy [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e68128a64baa4eb89f1454f94115ae1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f776a79a5746ae840d47da420daedc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:33:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Creating image(s)
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "/opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "/opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.282s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk 1073741824" returned: 0 in 0.065s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Successfully created port: 2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:33:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Cannot resize image /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.objects.instance [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'migration_context' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Ensure instance console log exists: /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Successfully updated port: 2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquired lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-changed-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG nova.compute.manager [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Refreshing instance network info cache due to event network-changed-2502b77b-30d7-4125-a5cf-8e88e33e9017. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:33:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] Acquiring lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating instance_info_cache with network_info: [{"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Releasing lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Instance network_info: |[{"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] Acquired lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.neutron [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Refreshing network info cache for port 2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Start _get_guest_xml network_info=[{"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:33:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-377827314',display_name='tempest-AttachVolumeNegativeTest-server-377827314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-377827314',id=33,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATm72fO1HnqDxrWy5J+sftOPZL6wXrvusEaU26uNWtN4Dr3X8LRmKH7pLZNpfmDA5UXF0xDH5X9QXqt/kXSKmhLK0vLhTVaEnWfj1q9kxIYs2V73w2iQKS7CyYqWrkQAg==',key_name='tempest-keypair-2012086526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-fpq7nyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=d711289a-8c75-40fc-a55b-c0d6478b664f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'pci_devices' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:33:33 user nova-compute[72863]:   <uuid>d711289a-8c75-40fc-a55b-c0d6478b664f</uuid>
Aug 15 13:33:33 user nova-compute[72863]:   <name>instance-00000021</name>
Aug 15 13:33:33 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:33:33 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:33:33 user nova-compute[72863]:   <metadata>
Aug 15 13:33:33 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:33:33 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeNegativeTest-server-377827314</nova:name>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:33:33</nova:creationTime>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:33:33 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:33:33 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:owner>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:user uuid="e68128a64baa4eb89f1454f94115ae1c">tempest-AttachVolumeNegativeTest-1688916020-project-member</nova:user>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:project uuid="67f776a79a5746ae840d47da420daedc">tempest-AttachVolumeNegativeTest-1688916020</nova:project>
Aug 15 13:33:33 user nova-compute[72863]:       </nova:owner>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:33:33 user nova-compute[72863]:       <nova:ports>
Aug 15 13:33:33 user nova-compute[72863]:         <nova:port uuid="2502b77b-30d7-4125-a5cf-8e88e33e9017">
Aug 15 13:33:33 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 13:33:33 user nova-compute[72863]:         </nova:port>
Aug 15 13:33:33 user nova-compute[72863]:       </nova:ports>
Aug 15 13:33:33 user nova-compute[72863]:     </nova:instance>
Aug 15 13:33:33 user nova-compute[72863]:   </metadata>
Aug 15 13:33:33 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:33:33 user nova-compute[72863]:     <system>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="serial">d711289a-8c75-40fc-a55b-c0d6478b664f</entry>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="uuid">d711289a-8c75-40fc-a55b-c0d6478b664f</entry>
Aug 15 13:33:33 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:33:33 user nova-compute[72863]:     </system>
Aug 15 13:33:33 user nova-compute[72863]:   </sysinfo>
Aug 15 13:33:33 user nova-compute[72863]:   <os>
Aug 15 13:33:33 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:33:33 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:33:33 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:33:33 user nova-compute[72863]:   </os>
Aug 15 13:33:33 user nova-compute[72863]:   <features>
Aug 15 13:33:33 user nova-compute[72863]:     <acpi/>
Aug 15 13:33:33 user nova-compute[72863]:     <apic/>
Aug 15 13:33:33 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:33:33 user nova-compute[72863]:   </features>
Aug 15 13:33:33 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:33:33 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:33:33 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:33:33 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:33:33 user nova-compute[72863]:   </clock>
Aug 15 13:33:33 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:33:33 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:33:33 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:33:33 user nova-compute[72863]:   </cpu>
Aug 15 13:33:33 user nova-compute[72863]:   <devices>
Aug 15 13:33:33 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:33:33 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:33:33 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk"/>
Aug 15 13:33:33 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:33:33 user nova-compute[72863]:     </disk>
Aug 15 13:33:33 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:33:33 user nova-compute[72863]:       <mac address="fa:16:3e:00:1b:cd"/>
Aug 15 13:33:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:33 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:33:33 user nova-compute[72863]:       <target dev="tap2502b77b-30"/>
Aug 15 13:33:33 user nova-compute[72863]:     </interface>
Aug 15 13:33:33 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:33:33 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/console.log" append="off"/>
Aug 15 13:33:33 user nova-compute[72863]:     </serial>
Aug 15 13:33:33 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:33:33 user nova-compute[72863]:     <video>
Aug 15 13:33:33 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:33:33 user nova-compute[72863]:     </video>
Aug 15 13:33:33 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:33:33 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:33:33 user nova-compute[72863]:     </rng>
Aug 15 13:33:33 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:33:33 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:33:33 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:33:33 user nova-compute[72863]:     </memballoon>
Aug 15 13:33:33 user nova-compute[72863]:   </devices>
Aug 15 13:33:33 user nova-compute[72863]: </domain>
Aug 15 13:33:33 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-377827314',display_name='tempest-AttachVolumeNegativeTest-server-377827314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-377827314',id=33,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATm72fO1HnqDxrWy5J+sftOPZL6wXrvusEaU26uNWtN4Dr3X8LRmKH7pLZNpfmDA5UXF0xDH5X9QXqt/kXSKmhLK0vLhTVaEnWfj1q9kxIYs2V73w2iQKS7CyYqWrkQAg==',key_name='tempest-keypair-2012086526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-fpq7nyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=d711289a-8c75-40fc-a55b-c0d6478b664f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG os_vif [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2502b77b-30, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2502b77b-30, col_values=(('external_ids', {'iface-id': '2502b77b-30d7-4125-a5cf-8e88e33e9017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1b:cd', 'vm-uuid': 'd711289a-8c75-40fc-a55b-c0d6478b664f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:33 user nova-compute[72863]: INFO os_vif [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30')
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:00:1b:cd, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:33:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG nova.network.neutron [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updated VIF entry in instance network info cache for port 2502b77b-30d7-4125-a5cf-8e88e33e9017. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG nova.network.neutron [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating instance_info_cache with network_info: [{"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7b3bd928-6478-4bbd-be11-416d2596fe21 req-45294ee3-fe75-4ab0-bf20-db7bf0198654 service nova] Releasing lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktRVHimo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:33:34 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:34 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:33:34 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf483a4-a7e0-467c-ab6d-a6b52addd688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:33:34 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc97921-18d4-41af-8b7e-5b2654c75dee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0] added
Aug 15 13:33:34 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac015ed-ffba-4482-9338-762fe1cc97f4]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147c6e2-c06b-4b0a-aa7a-b4f35de82ea0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktRVHimo {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktRVHimo" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[628be943-973f-4e4d-82e6-99338cfbf171]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktRVHimo'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab365e7-36f8-481b-85ad-76358269e58a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[437078b8-8602-4b77-ae4b-124628ae787f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1f5e6-360e-4e34-b0c5-f0d6c3165fdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260]
Aug 15 13:33:35 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260] successful.
Aug 15 13:33:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18921bbc-2c5d-4b55-9720-cd29e2a58b7d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf9ed9e-ddc5-4450-a913-daba2d2a2614]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)
Aug 15 13:33:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc003a-7bdb-4a1b-a6b5-a0af8feeb7c0]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktRVHimo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] No waiting events found dispatching network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:35 user nova-compute[72863]: WARNING nova.compute.manager [req-ce68a73c-c2be-4fb3-acec-f4217ac94ded req-72716c50-7d4d-4c43-8173-04a18bc2646a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received unexpected event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 for instance with vm_state building and task_state spawning.
Aug 15 13:33:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23939623431326566', 'path': '/dev/sdg'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939623431326566', 'path': '/dev/sdg'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:33:36 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:33:36 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:33:36 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:33:36 user nova-compute[72863]:   <serial>7376d7af-619e-444e-b987-d5309f0addd0</serial>
Aug 15 13:33:36 user nova-compute[72863]: </disk>
Aug 15 13:33:36 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] No VIF found with MAC fa:16:3e:ef:e9:22, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:33:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2ee48c13-9cf8-4910-8436-358b462c845d tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.434s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] No waiting events found dispatching network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:33:37 user nova-compute[72863]: WARNING nova.compute.manager [req-db368c89-3540-4639-b440-3778f5df82ef req-de1c49e9-12e9-4081-acb8-69f750422902 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received unexpected event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 for instance with vm_state building and task_state spawning.
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106417.4108949, d711289a-8c75-40fc-a55b-c0d6478b664f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] VM Resumed (Lifecycle Event)
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Instance spawned successfully.
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106417.4125094, d711289a-8c75-40fc-a55b-c0d6478b664f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] VM Started (Lifecycle Event)
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 15 13:33:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:33:37 user nova-compute[72863]: INFO nova.compute.manager [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Took 8.26 seconds to build instance.
Aug 15 13:33:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-df494046-233f-4b12-996c-aea32e1756e6 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.462s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:33:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:33:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-changed-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Refreshing instance network info cache due to event network-changed-f53d3ea7-feb7-4e56-b28b-74e26e418800. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:34:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] Acquiring lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] Acquired lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Refreshing network info cache for port f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:34:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updated VIF entry in instance network info cache for port f53d3ea7-feb7-4e56-b28b-74e26e418800. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:34:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updating instance_info_cache with network_info: [{"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9c1bb44f-b8c3-4985-b2fd-abce16bddbc2 req-52b87dac-286e-4e06-b682-e2fa99a6a071 service nova] Releasing lock "refresh_cache-2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:09 user nova-compute[72863]: INFO nova.compute.manager [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Detaching volume 7376d7af-619e-444e-b987-d5309f0addd0
Aug 15 13:34:09 user nova-compute[72863]: INFO nova.virt.block_device [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Attempting to driver detach volume 7376d7af-619e-444e-b987-d5309f0addd0 from mountpoint /dev/vdb
Aug 15 13:34:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Attempting to detach device vdb from instance dc2d8463-dd59-47ca-8142-28bd790cf247 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:34:09 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:34:09 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:34:09 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:34:09 user nova-compute[72863]:   <serial>7376d7af-619e-444e-b987-d5309f0addd0</serial>
Aug 15 13:34:09 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:34:09 user nova-compute[72863]: </disk>
Aug 15 13:34:09 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:34:09 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully detached device vdb from instance dc2d8463-dd59-47ca-8142-28bd790cf247 from the persistent domain config.
Aug 15 13:34:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc2d8463-dd59-47ca-8142-28bd790cf247 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:34:09 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:34:09 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:34:09 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:34:09 user nova-compute[72863]:   <serial>7376d7af-619e-444e-b987-d5309f0addd0</serial>
Aug 15 13:34:09 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:34:09 user nova-compute[72863]: </disk>
Aug 15 13:34:09 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106450.250432, dc2d8463-dd59-47ca-8142-28bd790cf247 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:34:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully detached device vdb from instance dc2d8463-dd59-47ca-8142-28bd790cf247 from the live domain config.
Aug 15 13:34:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktRVHimo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:10 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab92749-5dd3-40fe-895f-71a4fb560e26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b7809-bb9a-4825-a180-2a5b78c49714]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 (non-flash)
Aug 15 13:34:10 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff530862290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0'): ({'sdg'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Removing single pathed devices sdg {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f46d88-1107-4c5a-bb7e-2e6a0bb2e283]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf47fbc-51e2-4a17-af81-a33d3c87717a]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Flushing IO for device /dev/sdg {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be66447f-b19b-4b7c-ab72-befaae7c12d6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e60d61-9968-464e-a545-cebde3b63d31]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801812a-033a-4d8c-829e-75a46c62accc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b196a60-ae0c-4749-8e11-31d32e20779a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260]
Aug 15 13:34:10 user nova-compute[72863]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0, portal: 172.16.0.220,3260] successful.
Aug 15 13:34:10 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2922f1-a508-4025-b866-fdab946f1c3e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== disconnect_volume: return (316ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG nova.objects.instance [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'flavor' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-62760df1-dc4f-4245-b95d-de95343b8ddf tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.603s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:11 user nova-compute[72863]: INFO nova.compute.manager [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Terminating instance
Aug 15 13:34:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-unplugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] No waiting events found dispatching network-vif-unplugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-24714e66-4bcb-4eb9-8f66-b455d7c2bc16 req-9b51ddf9-c804-4d3f-a1dc-d3139db64187 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-unplugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Instance destroyed successfully.
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lazy-loading 'resources' on Instance uuid dc2d8463-dd59-47ca-8142-28bd790cf247 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-750912192',display_name='tempest-VolumesSnapshotTestJSON-instance-750912192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-750912192',id=30,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQzXTU7NUvGkym6MFinHsUzzCecuGxVMQk2u/IaHRMtsYs8LNADS4/Jcgu5fvZVY4SbYaYWUGJGtblzBxGWjIi5lsMYxsr85ZXbLyYXPj+zkdAriyN9mq7odlt/d+RtGA==',key_name='tempest-keypair-246562273',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:31:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='916d31a5dc5443e9bbe7045f316d0b7f',ramdisk_id='',reservation_id='r-bkrfhsha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1485635322',owner_user_name='tempest-VolumesSnapshotTestJSON-1485635322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:31:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='826608d086c948d499935fa979257ffa',uuid=dc2d8463-dd59-47ca-8142-28bd790cf247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converting VIF {"id": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "address": "fa:16:3e:ef:e9:22", "network": {"id": "8229fbf6-3d35-49c7-a412-cfa11ca5c5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1040079497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "916d31a5dc5443e9bbe7045f316d0b7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd10-49", "ovs_interfaceid": "0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_vif [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0ebd10-49, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:12 user nova-compute[72863]: INFO os_vif [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f,network=Network(8229fbf6-3d35-49c7-a412-cfa11ca5c5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd10-49')
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktRVHimo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:12 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7376d7af-619e-444e-b987-d5309f0addd0', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52adc9b-b83b-4fc3-8ded-dc343d496601]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29cf95-9c0c-4f63-9b73-a4f62bfbb039]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:12 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5241e2d40>, {}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Disconnecting from: [] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] <== disconnect_volume: return (59ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:34:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Deleting instance files /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247_del
Aug 15 13:34:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Deletion of /opt/stack/data/nova/instances/dc2d8463-dd59-47ca-8142-28bd790cf247_del complete
Aug 15 13:34:12 user nova-compute[72863]: INFO nova.compute.manager [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 13:34:12 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:34:12 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-62900645-c51d-4fe6-b7e1-ff7b9aaa21b4 req-95106057-6156-43e8-a47c-1c76ea98490b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-deleted-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:13 user nova-compute[72863]: INFO nova.compute.manager [req-62900645-c51d-4fe6-b7e1-ff7b9aaa21b4 req-95106057-6156-43e8-a47c-1c76ea98490b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Neutron deleted interface 0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f; detaching it from the instance and deleting it from the info cache
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.network.neutron [req-62900645-c51d-4fe6-b7e1-ff7b9aaa21b4 req-95106057-6156-43e8-a47c-1c76ea98490b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:13 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Took 0.85 seconds to deallocate network for instance.
Aug 15 13:34:13 user nova-compute[72863]: WARNING nova.volume.cinder [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Attachment 080a993e-0afd-475c-8562-950d127ff5cf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 080a993e-0afd-475c-8562-950d127ff5cf. (HTTP 404) (Request-ID: req-e4de92a2-6cc5-46ea-84b0-79801a9eb452)
Aug 15 13:34:13 user nova-compute[72863]: INFO nova.compute.manager [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-62900645-c51d-4fe6-b7e1-ff7b9aaa21b4 req-95106057-6156-43e8-a47c-1c76ea98490b service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Detach interface failed, port_id=0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f, reason: Instance dc2d8463-dd59-47ca-8142-28bd790cf247 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] Acquiring lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] No waiting events found dispatching network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:13 user nova-compute[72863]: WARNING nova.compute.manager [req-2a97f173-bd11-4cc1-83fc-ffb1cd73b2de req-f5f88656-3765-481f-9e6e-9b88f0accd94 service nova] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Received unexpected event network-vif-plugged-0a0ebd10-49c0-4bfe-8166-1d1a6e6cad8f for instance with vm_state deleted and task_state None.
Aug 15 13:34:14 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:34:14 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:34:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.770s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:14 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Deleted allocations for instance dc2d8463-dd59-47ca-8142-28bd790cf247
Aug 15 13:34:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-619f6863-3a70-4d6b-9ccb-defcf753f356 tempest-VolumesSnapshotTestJSON-1485635322 tempest-VolumesSnapshotTestJSON-1485635322-project-member] Lock "dc2d8463-dd59-47ca-8142-28bd790cf247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:34:19 user nova-compute[72863]: INFO nova.compute.claims [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Claim successful on node user
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:34:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:34:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:20 user nova-compute[72863]: INFO nova.virt.block_device [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Booting with volume snapshot 96b4eb75-a8ec-4f14-a600-925472a89548 at /dev/vda
Aug 15 13:34:20 user nova-compute[72863]: DEBUG nova.policy [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Successfully created port: 27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Successfully updated port: 27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-changed-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Refreshing instance network info cache due to event network-changed-27128c94-1fa1-4e40-b068-fe4190877afb. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] Acquiring lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:34:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updating instance_info_cache with network_info: [{"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Instance network_info: |[{"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] Acquired lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Refreshing network info cache for port 27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updated VIF entry in instance network info cache for port 27128c94-1fa1-4e40-b068-fe4190877afb. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updating instance_info_cache with network_info: [{"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f93ecd0-dfda-4d32-b76d-b481db76bb5d req-6c9127c2-3379-4248-a715-a74df3792bbe service nova] Releasing lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:23 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:23 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6341MB free_disk=25.392715454101562GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Applying migration context for instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f as it has an incoming, in-progress migration 40616171-8c65-496d-b5e2-e45f29f9c7b0. Migration status is finished {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 13:34:24 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating resource usage from migration 40616171-8c65-496d-b5e2-e45f29f9c7b0
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Migration 40616171-8c65-496d-b5e2-e45f29f9c7b0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d711289a-8c75-40fc-a55b-c0d6478b664f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e4081ef7-9eae-42ab-ae5a-698dba6e3723 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:34:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa652c9-7df5-4cf9-b9ac-b71f34c37ae8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac8e4c-7836-4cd2-a049-c8db8a13b1eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec767065-5665-4bf4-80ed-b0f02b3d85f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068c5b1-2a74-4ebf-9cea-9d44b98aec12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:26 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a0b0e-6e36-4823-8f26-43f53fcd93c8]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updating existing volume attachment record: 0f4b9a2b-14da-4e62-8e4e-b3b42d389d52 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:27 user nova-compute[72863]: INFO nova.compute.manager [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Terminating instance
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106452.1927407, dc2d8463-dd59-47ca-8142-28bd790cf247 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:27 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] VM Stopped (Lifecycle Event)
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3509d4df-36fd-4cc0-877c-5e16e0e777c1 None None] [instance: dc2d8463-dd59-47ca-8142-28bd790cf247] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-f7f2b650-20dc-4698-9040-c317593c49a2 req-7de1a850-d9c5-46d2-81db-d88a8504d081 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-unplugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:34:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Instance destroyed successfully.
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lazy-loading 'resources' on Instance uuid ba59f9b3-1f58-40f7-a9a3-a768abf0570d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-707763085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1568403430',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUtEjugyILP+WhmrLVGYVumQcmXg31Mkile6+z8Rzz4aKPTQjDpRJ5SOF/mhepptb4bis7PHtrBJomXS991YUyXcSUgFFM1ZFjqRIgn+lBe2TBCpgmyZmhsWSWuzFEVg==',key_name='tempest-keypair-380184728',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48481eca81a74f65b273919037f1677c',ramdisk_id='',reservation_id='r-59e1wssd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1961177819',owner_user_name='tempest-ServerActionsV293TestJSON-1961177819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b3145c37cde4968bafdb06a74599170',uuid=ba59f9b3-1f58-40f7-a9a3-a768abf0570d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converting VIF {"id": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "address": "fa:16:3e:e7:ef:42", "network": {"id": "af62562f-b72a-4363-b4ef-2d4bcdafdfa6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1312584957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48481eca81a74f65b273919037f1677c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f3c102-8d", "ovs_interfaceid": "99f3c102-8d72-48ae-a59a-8bea7f581c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_vif [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f3c102-8d, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:27 user nova-compute[72863]: INFO os_vif [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ef:42,bridge_name='br-int',has_traffic_filtering=True,id=99f3c102-8d72-48ae-a59a-8bea7f581c01,network=Network(af62562f-b72a-4363-b4ef-2d4bcdafdfa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f3c102-8d')
Aug 15 13:34:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kyaEdtfv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a85296-1032-4d68-9199-3314497c1ef3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f13dbd-3a92-462e-99b0-81ae9f00a907]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c (non-flash)
Aug 15 13:34:27 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c2593f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb40efe-1103-4fe5-85ef-33042356be5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3463a26d-50fd-4c20-a672-2218fd8ff3bc]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:34:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[204bef61-b053-4a75-b4b4-da09095d8116]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a6d638-a014-49be-b5bd-ba3cc2d34490]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf2ca8d-9254-4471-965b-8fa86da11fdd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5f21d-daed-490f-ad65-fc218f391d46]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260]
Aug 15 13:34:28 user nova-compute[72863]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c, portal: 172.16.0.220,3260] successful.
Aug 15 13:34:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f596040-d69d-4f23-b0aa-c392aa45135c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] <== disconnect_volume: return (356ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:34:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deleting instance files /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d_del
Aug 15 13:34:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deletion of /opt/stack/data/nova/instances/ba59f9b3-1f58-40f7-a9a3-a768abf0570d_del complete
Aug 15 13:34:28 user nova-compute[72863]: INFO nova.compute.manager [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:34:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] Acquiring lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] No waiting events found dispatching network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:29 user nova-compute[72863]: WARNING nova.compute.manager [req-77e8c013-6fb8-4768-a3dd-71a513051645 req-6e5ae7c8-7d61-4bc0-8020-94e9f02023ea service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received unexpected event network-vif-plugged-99f3c102-8d72-48ae-a59a-8bea7f581c01 for instance with vm_state active and task_state deleting.
Aug 15 13:34:29 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:29 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Took 1.25 seconds to deallocate network for instance.
Aug 15 13:34:29 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:30 user nova-compute[72863]: INFO nova.compute.manager [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 13:34:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Deleting volume: 02115e90-b2d1-4b9b-84b3-f7d65ceb1b0c {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:34:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:30 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Deleted allocations for instance ba59f9b3-1f58-40f7-a9a3-a768abf0570d
Aug 15 13:34:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-57253f25-ef15-444b-b566-1eb686fca735 tempest-ServerActionsV293TestJSON-1961177819 tempest-ServerActionsV293TestJSON-1961177819-project-member] Lock "ba59f9b3-1f58-40f7-a9a3-a768abf0570d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.010s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:31 user nova-compute[72863]: DEBUG nova.compute.manager [req-dcdb10c7-48b3-4d70-8f4c-116ac6d4e9d5 req-63cc79e9-99c4-4bfd-979b-282b22ad0726 service nova] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Received event network-vif-deleted-99f3c102-8d72-48ae-a59a-8bea7f581c01 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG nova.objects.instance [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'flavor' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:33 user nova-compute[72863]: INFO nova.compute.manager [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attaching volume d7efbfde-b00d-46b8-9dcd-b6397ae06096 to /dev/vdb
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.utils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce608bdc-9edc-413e-aa3d-bd23715d2d27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[688879a0-7529-49b8-9e89-80ef19be1767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bea983-ca17-4d19-9a90-db92dd553213]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8b66b3-fd6c-452e-b661-6733ef810eab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:33 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:34:33 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a995a47-6abe-4686-8c35-6b1344b60f2b]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG os_brick.utils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:33 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating existing volume attachment record: 44f6716d-eacb-4be1-8116-a2b80ca561ce {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:34:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Creating image(s)
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Ensure instance console log exists: /opt/stack/data/nova/instances/e4081ef7-9eae-42ab-ae5a-698dba6e3723/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Start _get_guest_xml network_info=[{"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T13:34:10Z,direct_url=<?>,disk_format='qcow2',id=74f65b3c-b8d1-4420-8e36-39ea61c78558,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1275561825',owner='cc53f1a137d047dc9e07af4222644667',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T13:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0f4b9a2b-14da-4e62-8e4e-b3b42d389d52', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvUVGclF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4081ef7-9eae-42ab-ae5a-698dba6e3723', 'attached_at': '', 'detached_at': '', 'volume_id': '3d5a0732-d9e1-4acc-96a7-7f813b33b5d1', 'serial': '3d5a0732-d9e1-4acc-96a7-7f813b33b5d1'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:34:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T13:34:10Z,direct_url=<?>,disk_format='qcow2',id=74f65b3c-b8d1-4420-8e36-39ea61c78558,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1275561825',owner='cc53f1a137d047dc9e07af4222644667',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T13:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvUVGclF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:35 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:35 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:35 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f95511-b9ee-4ccf-859a-3d5ef99248b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:34:35 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10699120-70cb-405b-920b-78880cba201d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1] added
Aug 15 13:34:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f351c93-0604-43a1-ac63-ba120590a795]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d1229-579a-4e7a-8673-4c9fe20bd705]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvUVGclF {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvUVGclF" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a666143-dd76-4722-ab19-6aa07a974d9f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvUVGclF'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03da3e88-1bc1-4479-a96d-8e479eccd41e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a0818-9692-4cea-96f9-2a24f7589ff7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a44ee-86f6-48a1-a6cc-51bc42049561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260]
Aug 15 13:34:36 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260] successful.
Aug 15 13:34:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[42abe2f0-44f5-496d-8e38-d0edcc4caa5a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1652d9-6869-466f-8f9c-d99dd004b09d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ad31d1-5188-4776-b9c8-bf03aaca00ba]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:34:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvUVGclF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26135653732353062', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135653732353062', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1560677776',id=34,image_ref='74f65b3c-b8d1-4420-8e36-39ea61c78558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcw3qK2E9qGBQKtLnRX6fJdR/sRLVMJyRmL596ukzqs1ze3rsUEfF7q7SDUYIbY13ZQNf5Cho7SVmrKJ7GI31I+EVobA7qNm33YMRnjR/UEdHtHyMwrT342UT5mRBiDjw==',key_name='tempest-keypair-1918344676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-1o67tdfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1735501215',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=e4081ef7-9eae-42ab-ae5a-698dba6e3723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid e4081ef7-9eae-42ab-ae5a-698dba6e3723 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:34:37 user nova-compute[72863]:   <uuid>e4081ef7-9eae-42ab-ae5a-698dba6e3723</uuid>
Aug 15 13:34:37 user nova-compute[72863]:   <name>instance-00000022</name>
Aug 15 13:34:37 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:34:37 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:34:37 user nova-compute[72863]:   <metadata>
Aug 15 13:34:37 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:34:37 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1560677776</nova:name>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:34:35</nova:creationTime>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:34:37 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:34:37 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:owner>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:34:37 user nova-compute[72863]:       </nova:owner>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:root type="image" uuid="74f65b3c-b8d1-4420-8e36-39ea61c78558"/>
Aug 15 13:34:37 user nova-compute[72863]:       <nova:ports>
Aug 15 13:34:37 user nova-compute[72863]:         <nova:port uuid="27128c94-1fa1-4e40-b068-fe4190877afb">
Aug 15 13:34:37 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 13:34:37 user nova-compute[72863]:         </nova:port>
Aug 15 13:34:37 user nova-compute[72863]:       </nova:ports>
Aug 15 13:34:37 user nova-compute[72863]:     </nova:instance>
Aug 15 13:34:37 user nova-compute[72863]:   </metadata>
Aug 15 13:34:37 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:34:37 user nova-compute[72863]:     <system>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="serial">e4081ef7-9eae-42ab-ae5a-698dba6e3723</entry>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="uuid">e4081ef7-9eae-42ab-ae5a-698dba6e3723</entry>
Aug 15 13:34:37 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:34:37 user nova-compute[72863]:     </system>
Aug 15 13:34:37 user nova-compute[72863]:   </sysinfo>
Aug 15 13:34:37 user nova-compute[72863]:   <os>
Aug 15 13:34:37 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:34:37 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:34:37 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:34:37 user nova-compute[72863]:   </os>
Aug 15 13:34:37 user nova-compute[72863]:   <features>
Aug 15 13:34:37 user nova-compute[72863]:     <acpi/>
Aug 15 13:34:37 user nova-compute[72863]:     <apic/>
Aug 15 13:34:37 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:34:37 user nova-compute[72863]:   </features>
Aug 15 13:34:37 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:34:37 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:34:37 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:34:37 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:34:37 user nova-compute[72863]:   </clock>
Aug 15 13:34:37 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:34:37 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:34:37 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:34:37 user nova-compute[72863]:   </cpu>
Aug 15 13:34:37 user nova-compute[72863]:   <devices>
Aug 15 13:34:37 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:34:37 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:34:37 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:34:37 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:34:37 user nova-compute[72863]:       <serial>3d5a0732-d9e1-4acc-96a7-7f813b33b5d1</serial>
Aug 15 13:34:37 user nova-compute[72863]:     </disk>
Aug 15 13:34:37 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:34:37 user nova-compute[72863]:       <mac address="fa:16:3e:1b:cc:87"/>
Aug 15 13:34:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:34:37 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:34:37 user nova-compute[72863]:       <target dev="tap27128c94-1f"/>
Aug 15 13:34:37 user nova-compute[72863]:     </interface>
Aug 15 13:34:37 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:34:37 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/e4081ef7-9eae-42ab-ae5a-698dba6e3723/console.log" append="off"/>
Aug 15 13:34:37 user nova-compute[72863]:     </serial>
Aug 15 13:34:37 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:34:37 user nova-compute[72863]:     <video>
Aug 15 13:34:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:34:37 user nova-compute[72863]:     </video>
Aug 15 13:34:37 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:34:37 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:34:37 user nova-compute[72863]:     </rng>
Aug 15 13:34:37 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:34:37 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:34:37 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:34:37 user nova-compute[72863]:     </memballoon>
Aug 15 13:34:37 user nova-compute[72863]:   </devices>
Aug 15 13:34:37 user nova-compute[72863]: </domain>
Aug 15 13:34:37 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1560677776',id=34,image_ref='74f65b3c-b8d1-4420-8e36-39ea61c78558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcw3qK2E9qGBQKtLnRX6fJdR/sRLVMJyRmL596ukzqs1ze3rsUEfF7q7SDUYIbY13ZQNf5Cho7SVmrKJ7GI31I+EVobA7qNm33YMRnjR/UEdHtHyMwrT342UT5mRBiDjw==',key_name='tempest-keypair-1918344676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-1o67tdfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1735501215',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=e4081ef7-9eae-42ab-ae5a-698dba6e3723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG os_vif [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27128c94-1f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27128c94-1f, col_values=(('external_ids', {'iface-id': '27128c94-1fa1-4e40-b068-fe4190877afb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:cc:87', 'vm-uuid': 'e4081ef7-9eae-42ab-ae5a-698dba6e3723'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:37 user nova-compute[72863]: INFO os_vif [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f')
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:1b:cc:87, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] No waiting events found dispatching network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:38 user nova-compute[72863]: WARNING nova.compute.manager [req-3e4f58ee-240e-4397-a780-af9028cd8240 req-c79d8a58-26b9-47b3-abd0-6a10f00f7780 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received unexpected event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb for instance with vm_state building and task_state spawning.
Aug 15 13:34:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] No waiting events found dispatching network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:40 user nova-compute[72863]: WARNING nova.compute.manager [req-a0684d03-ab60-40e6-9b6b-ae6a80c60f52 req-9ef5a335-3f5e-4862-868d-2256e1cef56a service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received unexpected event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb for instance with vm_state building and task_state spawning.
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106480.9171479, e4081ef7-9eae-42ab-ae5a-698dba6e3723 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] VM Resumed (Lifecycle Event)
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:34:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Instance spawned successfully.
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:34:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106480.920751, e4081ef7-9eae-42ab-ae5a-698dba6e3723 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:40 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] VM Started (Lifecycle Event)
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:34:41 user nova-compute[72863]: INFO nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Took 5.22 seconds to spawn the instance on the hypervisor.
Aug 15 13:34:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:34:41 user nova-compute[72863]: INFO nova.compute.manager [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Took 21.81 seconds to build instance.
Aug 15 13:34:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0879d818-37d1-4a7a-9484-6ffb33c26ab5 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.957s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:42 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106467.7868176, ba59f9b3-1f58-40f7-a9a3-a768abf0570d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:42 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] VM Stopped (Lifecycle Event)
Aug 15 13:34:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9ff5ea0a-35c6-4122-8a44-111c21278ca5 None None] [instance: ba59f9b3-1f58-40f7-a9a3-a768abf0570d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:43 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c647679-6bea-4df5-9242-5a7d86dbadc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:34:43 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[90daa8d8-2039-4f1b-a18d-27f7ca72f8ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096] added
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85256b9e-66bf-429c-b1d0-bf2452af289a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bce680-6a57-4060-92fd-a48feffff9e0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkFiuRgO {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkFiuRgO" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02a531-ae12-4af0-b7db-4cf5ec0f4d5a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkFiuRgO'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213c506-d454-4009-9a71-ccc5878b9f57]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[319b5fac-e022-4d0a-aa80-3cf7d5183405]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c5279-8fb7-4228-b0e8-3abedee292d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260]
Aug 15 13:34:43 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260] successful.
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e13ea2-0959-402a-99ae-e850f212cc1f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d4a42-c294-4dd3-a481-80cd3e778867]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3951a9b-a191-407d-8a30-6b4e7dea541c]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:34:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:34:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23564386534616237', 'path': '/dev/sdg'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564386534616237', 'path': '/dev/sdg'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:34:44 user nova-compute[72863]: DEBUG nova.objects.instance [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'flavor' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:34:44 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:34:44 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:34:44 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:34:44 user nova-compute[72863]:   <serial>d7efbfde-b00d-46b8-9dcd-b6397ae06096</serial>
Aug 15 13:34:44 user nova-compute[72863]: </disk>
Aug 15 13:34:44 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Port a249e220-f1eb-4dee-9aaf-f12953a48bbd binding to destination host user is already ACTIVE {{(pid=72863) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No VIF found with MAC fa:16:3e:0d:0c:af, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-16a3a457-bc1d-4efa-957b-353f1302d4a4 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.641s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Creating tmpfile /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/tmpimr4pa_p to verify with other compute node that the instance is on the same shared storage. {{(pid=72863) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:45 user nova-compute[72863]: INFO nova.compute.manager [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Rescuing
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:45 user nova-compute[72863]: WARNING nova.compute.manager [req-dbb42038-f27a-4066-a056-5f156a6f307d req-fbc61608-1aff-4a34-b6ae-f0363e94e3ce service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state resized and task_state resize_reverting.
Aug 15 13:34:46 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance destroyed successfully.
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'resources' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa249e220-f1, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: INFO os_vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e1804-9d45-42a9-a559-6066db43c0cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a870f-eb73-4381-bfbc-02be907227e7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff524078d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'): ({'sdf'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Removing single pathed devices sdf {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ed7a43-8e04-4461-8c25-06545c118c7b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19193ba-6e8c-4dcd-8c17-fa622740a2fb]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flushing IO for device /dev/sdf {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb2a059-5068-404d-9d8e-08ac21f20759]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e7121-365a-438d-b779-70e1c2f92ab5]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5774b119-cf8b-4c7c-99a1-76488aa211c7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:46 user nova-compute[72863]: WARNING nova.compute.manager [req-28cd7c1e-08a6-4082-9d16-f4b2d6df15e7 req-2c4898ea-e9fd-496f-9b79-63565472152e service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state active and task_state rescuing.
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee76e66-c750-47ba-9956-88ef175850e1]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:34:46 user nova-compute[72863]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:34:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce1ec2-cf19-436d-b415-fe1fe73a1971]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== disconnect_volume: return (406ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:34:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance destroyed successfully.
Aug 15 13:34:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attempting a stable device rescue
Aug 15 13:34:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72863) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:34:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Creating image(s)
Aug 15 13:34:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:48 user nova-compute[72863]: WARNING nova.compute.manager [req-ee83bca4-bdb3-4c3c-a991-8145a3e4e26b req-897fe745-c289-4af8-920c-5f983df1ca66 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state resized and task_state resize_reverting.
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'migration_context' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.part --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.virt.images [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] 19a64789-dddf-45d8-bb45-62394cf5c491 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.part /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:48 user nova-compute[72863]: WARNING nova.compute.manager [req-475f2233-d7a4-46e7-8638-fe1e0e2ea8ca req-6490777d-6e9c-4691-a033-a929272345c1 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state active and task_state rescuing.
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.part /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.converted" returned: 0 in 0.165s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.869s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.628s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40 --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40,backing_fmt=raw /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40,backing_fmt=raw /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue" returned: 0 in 0.056s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "8c7c99514b34b8a6c8b08458a9f56486eaf52e40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'migration_context' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:49 user nova-compute[72863]: INFO nova.compute.manager [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Swapping old allocation on dict_keys(['ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81']) held by migration 40616171-8c65-496d-b5e2-e45f29f9c7b0 for instance
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start _get_guest_xml network_info=[{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "vif_mac": "fa:16:3e:0d:0c:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '19a64789-dddf-45d8-bb45-62394cf5c491', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '44f6716d-eacb-4be1-8116-a2b80ca561ce', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f6b53ea3-4cde-4488-b15e-52d522ac557e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7efbfde-b00d-46b8-9dcd-b6397ae06096', 'serial': 'd7efbfde-b00d-46b8-9dcd-b6397ae06096'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'resources' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'numa_topology' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:49 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:49 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Overwriting current allocation {'allocations': {'ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': '6cfea57273354f118f2cdc6734d0d796', 'user_id': '5c38ea4a412d4cb8ad2e8b7f89c3d5c4', 'consumer_generation': 1} on consumer 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:49 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ee992-da45-4e95-9457-5a4f1596e1d0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IkFiuRgO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 13:34:49 user nova-compute[72863]: node.name = iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096
Aug 15 13:34:49 user nova-compute[72863]: node.tpgt = -1
Aug 15 13:34:49 user nova-compute[72863]: node.startup = automatic
Aug 15 13:34:49 user nova-compute[72863]: node.leading_login = No
Aug 15 13:34:49 user nova-compute[72863]: iface.iscsi_ifacename = default
Aug 15 13:34:49 user nova-compute[72863]: iface.net_ifacename = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.ipaddress = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.prefix_len = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.hwaddress = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.transport_name = tcp
Aug 15 13:34:49 user nova-compute[72863]: iface.initiatorname = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.vlan_id = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.vlan_priority = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.vlan_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.iface_num = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.mtu = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.port = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.bootproto = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.subnet_mask = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.gateway = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_alt_client_id = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_dns = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_learn_iqn = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_vendor_id_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_vendor_id = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.dhcp_slp_da = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.fragmentation = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.gratuitous_arp = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.incoming_forwarding = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.tos_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.tos = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.ttl = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.delayed_ack = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.tcp_nagle = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.tcp_wsf_state = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.tcp_wsf = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.tcp_timer_scale = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.tcp_timestamp = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.redirect = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.def_task_mgmt_timeout = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.header_digest = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.data_digest = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.immediate_data = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.initial_r2t = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.data_seq_inorder = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.data_pdu_inorder = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.erl = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.max_receive_data_len = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.first_burst_len = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.max_outstanding_r2t = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.max_burst_len = 0
Aug 15 13:34:49 user nova-compute[72863]: iface.chap_auth = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.bidi_chap = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.strict_login_compliance = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.discovery_auth = <empty>
Aug 15 13:34:49 user nova-compute[72863]: iface.discovery_logout = <empty>
Aug 15 13:34:49 user nova-compute[72863]: node.discovery_address = <empty>
Aug 15 13:34:49 user nova-compute[72863]: node.discovery_port = 0
Aug 15 13:34:49 user nova-compute[72863]: node.discovery_type = static
Aug 15 13:34:49 user nova-compute[72863]: node.session.initial_cmdsn = 0
Aug 15 13:34:49 user nova-compute[72863]: node.session.initial_login_retry_max = 8
Aug 15 13:34:49 user nova-compute[72863]: node.session.xmit_thread_priority = -20
Aug 15 13:34:49 user nova-compute[72863]: node.session.cmds_max = 128
Aug 15 13:34:49 user nova-compute[72863]: node.session.queue_depth = 32
Aug 15 13:34:49 user nova-compute[72863]: node.session.nr_sessions = 1
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.authmethod = CHAP
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.username = IkFiuRgO
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.password = ***
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.username_in = <empty>
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.password_in = <empty>
Aug 15 13:34:49 user nova-compute[72863]: node.session.auth.chap_algs = MD5
Aug 15 13:34:49 user nova-compute[72863]: node.session.timeo.replacement_timeout = 120
Aug 15 13:34:49 user nova-compute[72863]: node.session.err_timeo.abort_timeout = 15
Aug 15 13:34:49 user nova-compute[72863]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 13:34:49 user nova-compute[72863]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 13:34:49 user nova-compute[72863]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.FastAbort = Yes
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.InitialR2T = No
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.ImmediateData = Yes
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.MaxConnections = 1
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 13:34:49 user nova-compute[72863]: node.session.iscsi.ERL = 0
Aug 15 13:34:49 user nova-compute[72863]: node.session.scan = manual
Aug 15 13:34:49 user nova-compute[72863]: node.session.reopen_max = 0
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].address = 172.16.0.220
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].port = 3260
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].startup = manual
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].tcp.window_size = 524288
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].tcp.type_of_service = 0
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].timeo.logout_timeout = 15
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].timeo.login_timeout = 15
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].timeo.auth_timeout = 45
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.DataDigest = None
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.IFMarker = No
Aug 15 13:34:49 user nova-compute[72863]: node.conn[0].iscsi.OFMarker = No
Aug 15 13:34:49 user nova-compute[72863]: # END RECORD
Aug 15 13:34:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[758e0398-fa94-4c5d-adb8-3c20bfd54516]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573e8b6-da3e-458c-b415-c05eb8528451]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkFiuRgO {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkFiuRgO" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e177afb-7daa-4374-a269-679065e7aa1b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkFiuRgO'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519fed3-7bde-4910-9d0f-ae273e3c2b82]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e171a789-acc9-4dd1-a4e6-f11e6e6b5551]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:34:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] HCTL ('38', '0', '0', 0) found on session 34 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6285972-8565-412d-98fe-1e27a04f4c8c]: (4, ('0 0 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Searching for a device in session 34 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '23564386534616237', 'path': '/dev/sdg'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564386534616237', 'path': '/dev/sdg'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-545359356',display_name='tempest-ServerStableDeviceRescueTest-server-545359356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-545359356',id=29,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlwyH2myAPySn5x6PNkp2gpy5J2NL3Uyat6gEr8HGloj1v2tnIcad8iCfPcZCFitHnYRkj35+HXQO7njTkU3ciMsVD7GnbEiuyJMA/SjXMCmdM57pZro2H9qLP7LLvojA==',key_name='tempest-keypair-858193593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffea36ec1e34d8fa6c4c9c66fc4a8da',ramdisk_id='',reservation_id='r-wnc2l5je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1470876027',owner_user_name='tempest-ServerStableDeviceRescueTest-1470876027-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6d22cd35c54349868cd6ecacc7340c',uuid=f6b53ea3-4cde-4488-b15e-52d522ac557e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "vif_mac": "fa:16:3e:0d:0c:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converting VIF {"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "vif_mac": "fa:16:3e:0d:0c:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:34:49 user nova-compute[72863]:   <uuid>f6b53ea3-4cde-4488-b15e-52d522ac557e</uuid>
Aug 15 13:34:49 user nova-compute[72863]:   <name>instance-0000001d</name>
Aug 15 13:34:49 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:34:49 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:34:49 user nova-compute[72863]:   <metadata>
Aug 15 13:34:49 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:34:49 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-545359356</nova:name>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:34:49</nova:creationTime>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:34:49 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:34:49 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:owner>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:user uuid="5f6d22cd35c54349868cd6ecacc7340c">tempest-ServerStableDeviceRescueTest-1470876027-project-member</nova:user>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:project uuid="bffea36ec1e34d8fa6c4c9c66fc4a8da">tempest-ServerStableDeviceRescueTest-1470876027</nova:project>
Aug 15 13:34:49 user nova-compute[72863]:       </nova:owner>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:34:49 user nova-compute[72863]:       <nova:ports>
Aug 15 13:34:49 user nova-compute[72863]:         <nova:port uuid="f33b5663-b6a2-42b9-a763-22743af05207">
Aug 15 13:34:49 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 13:34:49 user nova-compute[72863]:         </nova:port>
Aug 15 13:34:49 user nova-compute[72863]:       </nova:ports>
Aug 15 13:34:49 user nova-compute[72863]:     </nova:instance>
Aug 15 13:34:49 user nova-compute[72863]:   </metadata>
Aug 15 13:34:49 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:34:49 user nova-compute[72863]:     <system>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="serial">f6b53ea3-4cde-4488-b15e-52d522ac557e</entry>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="uuid">f6b53ea3-4cde-4488-b15e-52d522ac557e</entry>
Aug 15 13:34:49 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:34:49 user nova-compute[72863]:     </system>
Aug 15 13:34:49 user nova-compute[72863]:   </sysinfo>
Aug 15 13:34:49 user nova-compute[72863]:   <os>
Aug 15 13:34:49 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:34:49 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:34:49 user nova-compute[72863]:   </os>
Aug 15 13:34:49 user nova-compute[72863]:   <features>
Aug 15 13:34:49 user nova-compute[72863]:     <acpi/>
Aug 15 13:34:49 user nova-compute[72863]:     <apic/>
Aug 15 13:34:49 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:34:49 user nova-compute[72863]:   </features>
Aug 15 13:34:49 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:34:49 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:34:49 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:34:49 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:34:49 user nova-compute[72863]:   </clock>
Aug 15 13:34:49 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:34:49 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:34:49 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:34:49 user nova-compute[72863]:   </cpu>
Aug 15 13:34:49 user nova-compute[72863]:   <devices>
Aug 15 13:34:49 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:34:49 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:34:49 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk"/>
Aug 15 13:34:49 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:34:49 user nova-compute[72863]:     </disk>
Aug 15 13:34:49 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:34:49 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:34:49 user nova-compute[72863]:       <source dev="/dev/sdg"/>
Aug 15 13:34:49 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:34:49 user nova-compute[72863]:       <serial>d7efbfde-b00d-46b8-9dcd-b6397ae06096</serial>
Aug 15 13:34:49 user nova-compute[72863]:     </disk>
Aug 15 13:34:49 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:34:49 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:34:49 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue"/>
Aug 15 13:34:49 user nova-compute[72863]:       <target dev="vdc" bus="virtio"/>
Aug 15 13:34:49 user nova-compute[72863]:       <boot order="1"/>
Aug 15 13:34:49 user nova-compute[72863]:     </disk>
Aug 15 13:34:49 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:34:49 user nova-compute[72863]:       <mac address="fa:16:3e:0d:0c:af"/>
Aug 15 13:34:49 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:34:49 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:34:49 user nova-compute[72863]:       <target dev="tapf33b5663-b6"/>
Aug 15 13:34:49 user nova-compute[72863]:     </interface>
Aug 15 13:34:49 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:34:49 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/console.log" append="off"/>
Aug 15 13:34:49 user nova-compute[72863]:     </serial>
Aug 15 13:34:49 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:34:49 user nova-compute[72863]:     <video>
Aug 15 13:34:49 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:34:49 user nova-compute[72863]:     </video>
Aug 15 13:34:49 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:34:49 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:34:49 user nova-compute[72863]:     </rng>
Aug 15 13:34:49 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:34:49 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:34:49 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:34:49 user nova-compute[72863]:     </memballoon>
Aug 15 13:34:49 user nova-compute[72863]:   </devices>
Aug 15 13:34:49 user nova-compute[72863]: </domain>
Aug 15 13:34:49 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:34:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance destroyed successfully.
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:34:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] No VIF found with MAC fa:16:3e:0d:0c:af, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG nova.network.neutron [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.utils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d3fbc-422e-46ba-9070-0604a991db3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07223a3-137c-427f-ae45-69d9a5374889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41099e-830f-40cb-b861-4a0cbb1bea50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb03842-4757-4ad1-9d8b-26c4105dbb1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:34:50 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:34:50 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b8e94-4695-4dfb-83c0-39b5cb4dd32a]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:34:50 user nova-compute[72863]: DEBUG os_brick.utils [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:51 user nova-compute[72863]: WARNING nova.compute.manager [req-74182228-176c-43fb-9e79-641a8afe96cb req-20d7d8f9-1f2b-4ce1-83ab-4920e12088d7 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state active and task_state rescuing.
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for f6b53ea3-4cde-4488-b15e-52d522ac557e due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106493.4234414, f6b53ea3-4cde-4488-b15e-52d522ac557e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Resumed (Lifecycle Event)
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e62bce61-3a4c-4f2d-9624-cf5df0947e9a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:34:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106493.4293296, f6b53ea3-4cde-4488-b15e-52d522ac557e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:34:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Started (Lifecycle Event)
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:34:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:34:53 user nova-compute[72863]: WARNING nova.compute.manager [req-8d42059f-a7a9-4c04-a909-bafb6d84be84 req-1112e2f5-6022-43c0-968e-ea90a3650757 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state rescued and task_state None.
Aug 15 13:34:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Starting finish_revert_migration {{(pid=72863) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start _get_guest_xml network_info=[{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e95853a8-967f-476a-a704-d2eb38a5041e', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '314a7b77-4fbc-4184-add3-7f1e44aa7b0f', 'attached_at': '2023-08-15T13:35:00.000000', 'detached_at': '', 'volume_id': 'f71a2a31-755b-42f6-8597-460e62faa878', 'serial': 'f71a2a31-755b-42f6-8597-460e62faa878'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:34:59 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:59 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'vcpu_model' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:34:59 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:59 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:34:59 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cea19e-2317-452c-9e04-83e8bcbfaaeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:34:59 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304a1a7-5fc4-4719-8770-26d6c2887393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878] added
Aug 15 13:34:59 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:34:59 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0dd5e-ffe0-4325-a0b7-9d392792f6fe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:00 user nova-compute[72863]: INFO nova.compute.manager [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Terminating instance
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82724ac-233a-43bc-956a-e6cff685f054]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtuRhwFc" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b0ee7-9857-439a-8113-43af9120ee30]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtuRhwFc'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dba262-f434-440d-b43d-2694ac66e5ad]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad10e2-80d0-44c3-b4e0-67db8973ed5f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4821ff-e433-4795-92e0-d5c01e2a76d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:35:00 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37d027-9895-460d-805d-937566cb7323]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b30ab6f-eb37-4479-b089-94cfab50c7aa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfa227-c989-4614-8b1a-0d7c7284826a]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-2651fcdb-f8a2-4b58-8971-643040990320 req-4e6b478f-528a-4ed4-9125-0991f6273dba service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-unplugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Instance destroyed successfully.
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'resources' on Instance uuid 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390587892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390587892',id=24,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-q8obhbh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:33:16Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "a47a22fa-295c-43a5-aa09-1174db28999f", "address": "fa:16:3e:91:1b:40", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa47a22fa-29", "ovs_interfaceid": "a47a22fa-295c-43a5-aa09-1174db28999f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_vif [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa47a22fa-29, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:35:00 user nova-compute[72863]: INFO os_vif [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:1b:40,bridge_name='br-int',has_traffic_filtering=True,id=a47a22fa-295c-43a5-aa09-1174db28999f,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa47a22fa-29')
Aug 15 13:35:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNDexcEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:00 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353936626366', 'path': '/dev/sdf'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.506s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ef274-1984-476c-99fc-6ea289ab86b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:35:01 user nova-compute[72863]:   <uuid>314a7b77-4fbc-4184-add3-7f1e44aa7b0f</uuid>
Aug 15 13:35:01 user nova-compute[72863]:   <name>instance-00000016</name>
Aug 15 13:35:01 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:35:01 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:35:01 user nova-compute[72863]:   <metadata>
Aug 15 13:35:01 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:35:01 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherB-server-1841832683</nova:name>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:34:59</nova:creationTime>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:35:01 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:35:01 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:owner>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:user uuid="5c38ea4a412d4cb8ad2e8b7f89c3d5c4">tempest-ServerActionsTestOtherB-852730704-project-member</nova:user>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:project uuid="6cfea57273354f118f2cdc6734d0d796">tempest-ServerActionsTestOtherB-852730704</nova:project>
Aug 15 13:35:01 user nova-compute[72863]:       </nova:owner>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:35:01 user nova-compute[72863]:       <nova:ports>
Aug 15 13:35:01 user nova-compute[72863]:         <nova:port uuid="a249e220-f1eb-4dee-9aaf-f12953a48bbd">
Aug 15 13:35:01 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 13:35:01 user nova-compute[72863]:         </nova:port>
Aug 15 13:35:01 user nova-compute[72863]:       </nova:ports>
Aug 15 13:35:01 user nova-compute[72863]:     </nova:instance>
Aug 15 13:35:01 user nova-compute[72863]:   </metadata>
Aug 15 13:35:01 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:35:01 user nova-compute[72863]:     <system>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="serial">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="uuid">314a7b77-4fbc-4184-add3-7f1e44aa7b0f</entry>
Aug 15 13:35:01 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:35:01 user nova-compute[72863]:     </system>
Aug 15 13:35:01 user nova-compute[72863]:   </sysinfo>
Aug 15 13:35:01 user nova-compute[72863]:   <os>
Aug 15 13:35:01 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:35:01 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:35:01 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:35:01 user nova-compute[72863]:   </os>
Aug 15 13:35:01 user nova-compute[72863]:   <features>
Aug 15 13:35:01 user nova-compute[72863]:     <acpi/>
Aug 15 13:35:01 user nova-compute[72863]:     <apic/>
Aug 15 13:35:01 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:35:01 user nova-compute[72863]:   </features>
Aug 15 13:35:01 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:35:01 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:35:01 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:35:01 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:35:01 user nova-compute[72863]:   </clock>
Aug 15 13:35:01 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:35:01 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:35:01 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:35:01 user nova-compute[72863]:   </cpu>
Aug 15 13:35:01 user nova-compute[72863]:   <devices>
Aug 15 13:35:01 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:35:01 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:35:01 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk"/>
Aug 15 13:35:01 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:35:01 user nova-compute[72863]:     </disk>
Aug 15 13:35:01 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:35:01 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:01 user nova-compute[72863]:       <source dev="/dev/sdf"/>
Aug 15 13:35:01 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:35:01 user nova-compute[72863]:       <serial>f71a2a31-755b-42f6-8597-460e62faa878</serial>
Aug 15 13:35:01 user nova-compute[72863]:     </disk>
Aug 15 13:35:01 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:35:01 user nova-compute[72863]:       <mac address="fa:16:3e:ca:73:dd"/>
Aug 15 13:35:01 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:35:01 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:35:01 user nova-compute[72863]:       <target dev="tapa249e220-f1"/>
Aug 15 13:35:01 user nova-compute[72863]:     </interface>
Aug 15 13:35:01 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:35:01 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/console.log" append="off"/>
Aug 15 13:35:01 user nova-compute[72863]:     </serial>
Aug 15 13:35:01 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:35:01 user nova-compute[72863]:     <video>
Aug 15 13:35:01 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:35:01 user nova-compute[72863]:     </video>
Aug 15 13:35:01 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:35:01 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:35:01 user nova-compute[72863]:     </rng>
Aug 15 13:35:01 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:35:01 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:35:01 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:35:01 user nova-compute[72863]:     </memballoon>
Aug 15 13:35:01 user nova-compute[72863]:   </devices>
Aug 15 13:35:01 user nova-compute[72863]: </domain>
Aug 15 13:35:01 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa249e220-f1, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa249e220-f1, col_values=(('external_ids', {'iface-id': 'a249e220-f1eb-4dee-9aaf-f12953a48bbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:73:dd', 'vm-uuid': '314a7b77-4fbc-4184-add3-7f1e44aa7b0f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106486.4066381, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:01 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Stopped (Lifecycle Event)
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea617619-a3e9-4f15-89cd-be01a07ffe4f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c3a1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:01 user nova-compute[72863]: INFO os_vif [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7a8a6ecf-2893-4886-9d89-70d4cc426329 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112b46e-613f-4550-8883-177e854c2017]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f40221-c30f-4e66-9a47-0f1a086e50a5]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e114468b-fde0-4f0d-8d67-a0f4ce8ab0a2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec3726-0459-4c1a-8a19-e79990e4ced3]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf26972-e74d-41c4-a2c1-efb60b78aa06]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf63dc-5922-486f-9d92-0608bfde4c7d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260]
Aug 15 13:35:01 user nova-compute[72863]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7e343-dda7-4247-be10-850b462cf0a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9a5df-6759-41b1-b15e-61a4ebebef63]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] <== disconnect_volume: return (842ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:35:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Deleting instance files /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7_del
Aug 15 13:35:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Deletion of /opt/stack/data/nova/instances/5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7_del complete
Aug 15 13:35:01 user nova-compute[72863]: INFO nova.compute.manager [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Took 1.73 seconds to destroy the instance on the hypervisor.
Aug 15 13:35:01 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:35:01 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:02 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Took 0.62 seconds to deallocate network for instance.
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] Acquiring lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] No waiting events found dispatching network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:02 user nova-compute[72863]: WARNING nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received unexpected event network-vif-plugged-a47a22fa-295c-43a5-aa09-1174db28999f for instance with vm_state active and task_state deleting.
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Received event network-vif-deleted-a47a22fa-295c-43a5-aa09-1174db28999f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:02 user nova-compute[72863]: INFO nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Neutron deleted interface a47a22fa-295c-43a5-aa09-1174db28999f; detaching it from the instance and deleting it from the info cache
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7a26f150-c768-4096-8e34-704c827a492b req-7beba3ee-380d-4eff-b9bb-9fbfd68f4690 service nova] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Detach interface failed, port_id=a47a22fa-295c-43a5-aa09-1174db28999f, reason: Instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:03 user nova-compute[72863]: WARNING nova.compute.manager [req-13b152d1-4fdc-4e3a-93da-8b071fa6b1cc req-c3b23945-e919-4676-bc04-a99f3aa1490a service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state resized and task_state resize_reverting.
Aug 15 13:35:03 user nova-compute[72863]: INFO nova.compute.manager [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Took 0.85 seconds to detach 1 volumes for instance.
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:03 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Deleted allocations for instance 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7
Aug 15 13:35:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2455ea15-a08d-41f5-bc22-3e382fc4ee8c tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.821s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106505.0552318, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Resumed (Lifecycle Event)
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance running successfully.
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] finish_revert_migration finished successfully. {{(pid=72863) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106505.0561304, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Started (Lifecycle Event)
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:05 user nova-compute[72863]: WARNING nova.compute.manager [req-abaf5394-9ac9-4e34-ac03-fa1187a3adac req-fbafbdac-78c3-4b87-849e-697f5073ced3 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state resized and task_state resize_reverting.
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-9e1064a5-76ea-414b-b759-fb99b8b8bd9e tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance to original state: 'active'
Aug 15 13:35:05 user nova-compute[72863]: INFO nova.compute.manager [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Unrescuing
Aug 15 13:35:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG nova.objects.instance [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'flavor' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:06 user nova-compute[72863]: WARNING nova.compute.manager [req-8ba63a2a-e304-44a0-879a-5187f521834e req-ed5e2d44-1fea-4bb1-aac8-4dc8cb2a509a service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:35:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance destroyed successfully.
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:08 user nova-compute[72863]: WARNING nova.compute.manager [req-1635c111-13b4-4715-a452-5d4fbbecf0d8 req-69ac1908-5481-4aec-8966-20a74f9be280 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:10 user nova-compute[72863]: WARNING nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:35:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:10 user nova-compute[72863]: WARNING nova.compute.manager [req-cfb00399-3964-4ecc-9414-a7bfae1f5b87 req-95d04903-7de9-40f5-9937-bc0f94bb958d service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-changed-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Refreshing instance network info cache due to event network-changed-617c3d83-7a55-40cb-ba1b-cee74c49cfcc. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] Acquiring lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] Acquired lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Refreshing network info cache for port 617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for eb797116-28dc-481b-af43-439920b4f269 due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106511.0476139, eb797116-28dc-481b-af43-439920b4f269 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Resumed (Lifecycle Event)
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-20a1e6ea-b9be-43c4-bcd7-bc783efd0271 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106511.048606, eb797116-28dc-481b-af43-439920b4f269 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:11 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Started (Lifecycle Event)
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updated VIF entry in instance network info cache for port 617c3d83-7a55-40cb-ba1b-cee74c49cfcc. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating instance_info_cache with network_info: [{"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-876e06b3-ecca-43ed-a51d-8e095b029123 req-0bdae58d-ebf8-43ca-9f86-304e37055c13 service nova] Releasing lock "refresh_cache-0a6ea5f3-c240-4483-8aaa-2da3a772e634" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:15 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106500.8049152, 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:15 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] VM Stopped (Lifecycle Event)
Aug 15 13:35:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-206ab06d-2a69-47f9-b877-f1f9a25f42b1 None None] [instance: 5ff26e3b-0f35-4e6d-9b07-cb16b555d1b7] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:16 user nova-compute[72863]: INFO nova.compute.manager [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attaching volume ad8027b5-3def-4974-9e58-294b2d6f074b to /dev/vdb
Aug 15 13:35:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.utils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa42784-d201-4f1e-b496-ccd54c85b48e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e42f81-37f4-4e30-83a4-b279d1ec8539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25881c7a-b403-439d-be0b-b115d67fa01f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf0eae-e69e-4eac-8417-5f5e8daf5c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:16 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:35:16 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da72a4-a035-4d00-86da-d514ed3ef672]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG os_brick.utils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:16 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating existing volume attachment record: 0de5e283-353e-46ba-87f9-17e2c5c0af24 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:35:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-changed-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Refreshing instance network info cache due to event network-changed-2502b77b-30d7-4125-a5cf-8e88e33e9017. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] Acquiring lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] Acquired lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG nova.network.neutron [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Refreshing network info cache for port 2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updated VIF entry in instance network info cache for port 2502b77b-30d7-4125-a5cf-8e88e33e9017. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating instance_info_cache with network_info: [{"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2a97f740-e665-4833-9178-6807701a0205 req-b524e821-e276-4f70-b440-fd3043423ebd service nova] Releasing lock "refresh_cache-d711289a-8c75-40fc-a55b-c0d6478b664f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:21 user nova-compute[72863]: INFO nova.compute.manager [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Detaching volume fc498af9-1027-4d0f-b25e-2d6cf3c99705
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:21 user nova-compute[72863]: INFO nova.virt.block_device [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Attempting to driver detach volume fc498af9-1027-4d0f-b25e-2d6cf3c99705 from mountpoint /dev/vdb
Aug 15 13:35:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Attempting to detach device vdb from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:21 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:21 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:35:21 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:21 user nova-compute[72863]:   <serial>fc498af9-1027-4d0f-b25e-2d6cf3c99705</serial>
Aug 15 13:35:21 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:35:21 user nova-compute[72863]: </disk>
Aug 15 13:35:21 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully detached device vdb from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the persistent domain config.
Aug 15 13:35:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:21 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:21 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:35:21 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:21 user nova-compute[72863]:   <serial>fc498af9-1027-4d0f-b25e-2d6cf3c99705</serial>
Aug 15 13:35:21 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:35:21 user nova-compute[72863]: </disk>
Aug 15 13:35:21 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106522.2908106, 246b401a-83c6-40d0-8f30-95af5cbebc35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully detached device vdb from instance 246b401a-83c6-40d0-8f30-95af5cbebc35 from the live domain config.
Aug 15 13:35:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCzqpOLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f50d347-56d2-4f4f-9875-ec1c41086468]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba6d47-e46f-49b2-a3f0-3525fd0e842c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5243a7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f72dd-9071-4227-b5f4-4964e54f9f3b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f85e251-4f24-4a11-974b-443ac38331ce]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647c7ad-f7d2-434f-9a5e-22e06396a134]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11257b-a763-4424-9559-90f817584bbc]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ec5e3-5009-45ed-842b-a88d5f465a4c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8ce90-acfd-4828-91f6-ae54d8da8710]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260]
Aug 15 13:35:22 user nova-compute[72863]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc498af9-1027-4d0f-b25e-2d6cf3c99705 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae070d9-aedf-4f6c-a0d3-a140457e0832]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== disconnect_volume: return (394ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'flavor' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c4f415a5-021e-4f67-84e8-3589ca069a2b tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.079s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:23 user nova-compute[72863]: INFO nova.compute.manager [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Attaching volume 84e13075-3fa0-4aff-b58a-7f88cc83994d to /dev/vdb
Aug 15 13:35:23 user nova-compute[72863]: DEBUG os_brick.utils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc887971-eff5-48d9-b199-d842fef3d49f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8d148a-de6d-4dd8-96fd-ffed5bced093]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11a11d-c6e6-4e0d-8e23-53b696cac333]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d4daf-ffc0-42a8-8955-84a017806361]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:24 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616445c-8d21-4da4-b8a6-22b1d68c4553]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG os_brick.utils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating existing volume attachment record: 22656f35-8338-4e3d-948d-0c1817f7ec8d {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:35:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=6804MB free_disk=25.312419891357422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d711289a-8c75-40fc-a55b-c0d6478b664f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e4081ef7-9eae-42ab-ae5a-698dba6e3723 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:35:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:35:26 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:35:26 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:35:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:35:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.866s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkJnGwlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:27 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:27 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8582db4-99f4-45e6-a4d2-1e58f487b489]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:35:27 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dae14a-38a8-49ed-8b3c-277dd7fa84ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b] added
Aug 15 13:35:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95450e-8fa7-4f54-b399-072ff1cad607]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f59aab-fc50-41c0-af57-6a94b07f5353]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkJnGwlE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkJnGwlE" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c9ac4-841d-4ffb-ad36-91b87185a495]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkJnGwlE'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[060eac7c-f5ac-40d3-8a2c-a0447c043e06]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb80f33f-44d5-4575-a458-8f2a6f3da660]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f5b3a9-7fde-4b07-8538-7aadd188f67f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260]
Aug 15 13:35:27 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:27 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f31cc2-374e-418f-b046-a9d05052f60d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adef8a6-cfa3-4c58-8b13-f826c2b0e12f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:28 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:28 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e60563-a907-4247-8672-abca5de9ad52]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:35:28 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkJnGwlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26633333939316161', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633333939316161', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.objects.instance [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:35:29 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:29 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:35:29 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:29 user nova-compute[72863]:   <serial>ad8027b5-3def-4974-9e58-294b2d6f074b</serial>
Aug 15 13:35:29 user nova-compute[72863]: </disk>
Aug 15 13:35:29 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No VIF found with MAC fa:16:3e:65:88:fb, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:35:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-527bd865-cc27-4fc1-b723-4fcd2f8f1c9b tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.389s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updating instance_info_cache with network_info: [{"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-212b0da2-d0da-4920-b26a-f7143ae7840f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:35:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFHilGSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:34 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:34 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:34 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ce887-a3e3-429a-97e7-3f02b4713d4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:35:34 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e6a01-936b-49ca-88f5-c786cb92d44e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d] added
Aug 15 13:35:34 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7202c54b-704a-49fc-94be-c6df593e0e1e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b969b91-5a00-4278-b838-6cc8cd778491]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFHilGSj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFHilGSj" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eadb7cc-1a55-4732-83b6-0dc53bc9ba9f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NFHilGSj'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[484782e3-1aa5-42af-a26b-d01ca3cd2abc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d35aeae-2d7d-4cc1-81e5-418e4e74ae8e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:34 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:34 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:34 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ad623-b231-42c2-b871-7c34fbfa04eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260]
Aug 15 13:35:35 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21d760-dbc0-43de-84e9-36e11ab32a81]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6550384c-8ce0-434f-89b0-43e75a84d3ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)
Aug 15 13:35:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:35 user nova-compute[72863]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)
Aug 15 13:35:35 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2387deb4-68c6-44b4-8902-99915f33d0eb]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFHilGSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:35 user nova-compute[72863]: INFO nova.compute.manager [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attaching volume 619d5f54-b63a-4410-8825-9261f97675a6 to /dev/vdc
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.utils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b461121b-3a80-4abb-a89d-3a8fcef05d0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee3cf7-d73d-488f-9cb1-c8df5c1f7877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8a30f-1dec-4c71-83d1-f10cba3568ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea209d25-02b0-4f1c-8c37-02977b15d5d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:35:35 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:35:35 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b0fe7-8f4f-4cb3-b15c-7eb033c1c919]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG os_brick.utils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:35 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating existing volume attachment record: ed5cdcae-34b4-414c-b0bd-40755905125b {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23737386666386662', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737386666386662', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:35:36 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:36 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:36 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:36 user nova-compute[72863]:   <serial>84e13075-3fa0-4aff-b58a-7f88cc83994d</serial>
Aug 15 13:35:36 user nova-compute[72863]: </disk>
Aug 15 13:35:36 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] No VIF found with MAC fa:16:3e:00:1b:cd, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:35:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-babc428c-6dd1-418b-a2bd-dc0bc9c698d2 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.904s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:37 user nova-compute[72863]: INFO nova.compute.manager [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Detaching volume 84e13075-3fa0-4aff-b58a-7f88cc83994d
Aug 15 13:35:37 user nova-compute[72863]: INFO nova.virt.block_device [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Attempting to driver detach volume 84e13075-3fa0-4aff-b58a-7f88cc83994d from mountpoint /dev/vdb
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Attempting to detach device vdb from instance d711289a-8c75-40fc-a55b-c0d6478b664f from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:37 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:37 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:37 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:37 user nova-compute[72863]:   <serial>84e13075-3fa0-4aff-b58a-7f88cc83994d</serial>
Aug 15 13:35:37 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:35:37 user nova-compute[72863]: </disk>
Aug 15 13:35:37 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance d711289a-8c75-40fc-a55b-c0d6478b664f from the persistent domain config.
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d711289a-8c75-40fc-a55b-c0d6478b664f from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:37 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:37 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:37 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:37 user nova-compute[72863]:   <serial>84e13075-3fa0-4aff-b58a-7f88cc83994d</serial>
Aug 15 13:35:37 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:35:37 user nova-compute[72863]: </disk>
Aug 15 13:35:37 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106537.8997772, d711289a-8c75-40fc-a55b-c0d6478b664f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:35:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully detached device vdb from instance d711289a-8c75-40fc-a55b-c0d6478b664f from the live domain config.
Aug 15 13:35:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFHilGSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bef029-2e8c-49a2-9877-54eaa98a762c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a48899-c5d5-4109-9f14-214e69df0898]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)
Aug 15 13:35:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:37 user nova-compute[72863]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d (non-flash)
Aug 15 13:35:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:35:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5c83c-2260-4df7-b5c4-ec7007b9e5c4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53bd25a-d261-45a2-b3b4-528ed526da5f]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[552111c4-9a60-4e00-8e69-52ba95eb996a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd69173-7d26-4e8b-83aa-4e2269486c6f]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d8324-13d0-4533-848e-21c1f0b3b149]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb723cd2-56ba-447c-9987-8355af8a3aa5]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260]
Aug 15 13:35:38 user nova-compute[72863]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:38 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e13075-3fa0-4aff-b58a-7f88cc83994d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd21e7-9949-4424-92e1-a1abb305899f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] <== disconnect_volume: return (325ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:35:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:39 user nova-compute[72863]: DEBUG nova.objects.instance [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'flavor' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-576531d0-65ba-4be4-8a7d-1348e324a9fa tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.867s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:35:43 user nova-compute[72863]: INFO nova.compute.claims [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Claim successful on node user
Aug 15 13:35:43 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:35:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.policy [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9193958f2cc9463fa7efcbbf9948c99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2496c50b62d47b191bd4a38de5232a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:35:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Creating image(s)
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "/opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "/opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "/opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk 1073741824" returned: 0 in 0.059s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.219s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:44 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Successfully created port: 848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Cannot resize image /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.objects.instance [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lazy-loading 'migration_context' on Instance uuid 72be1636-81d7-4811-9a3f-c96ecb86d232 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Ensure instance console log exists: /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Successfully updated port: 848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquired lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-changed-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Refreshing instance network info cache due to event network-changed-848f962e-34a0-4648-9e4b-cac8d037c6c9. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] Acquiring lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:35:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Updating instance_info_cache with network_info: [{"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Releasing lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Instance network_info: |[{"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] Acquired lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Refreshing network info cache for port 848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Start _get_guest_xml network_info=[{"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:35:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:35:46 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1796833898',display_name='tempest-VolumesActionsTest-instance-1796833898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1796833898',id=35,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2496c50b62d47b191bd4a38de5232a8',ramdisk_id='',reservation_id='r-rhu4vppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-195647813',owner_user_name='tempest-VolumesActionsTest-195647813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:35:44Z,user_data=None,user_id='9193958f2cc9463fa7efcbbf9948c99a',uuid=72be1636-81d7-4811-9a3f-c96ecb86d232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converting VIF {"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lazy-loading 'pci_devices' on Instance uuid 72be1636-81d7-4811-9a3f-c96ecb86d232 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYuWVPpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:46 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:35:46 user nova-compute[72863]:   <uuid>72be1636-81d7-4811-9a3f-c96ecb86d232</uuid>
Aug 15 13:35:46 user nova-compute[72863]:   <name>instance-00000023</name>
Aug 15 13:35:46 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:35:46 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:35:46 user nova-compute[72863]:   <metadata>
Aug 15 13:35:46 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:35:46 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:name>tempest-VolumesActionsTest-instance-1796833898</nova:name>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:35:46</nova:creationTime>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:35:46 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:35:46 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:owner>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:user uuid="9193958f2cc9463fa7efcbbf9948c99a">tempest-VolumesActionsTest-195647813-project-member</nova:user>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:project uuid="f2496c50b62d47b191bd4a38de5232a8">tempest-VolumesActionsTest-195647813</nova:project>
Aug 15 13:35:46 user nova-compute[72863]:       </nova:owner>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:35:46 user nova-compute[72863]:       <nova:ports>
Aug 15 13:35:46 user nova-compute[72863]:         <nova:port uuid="848f962e-34a0-4648-9e4b-cac8d037c6c9">
Aug 15 13:35:46 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 13:35:46 user nova-compute[72863]:         </nova:port>
Aug 15 13:35:46 user nova-compute[72863]:       </nova:ports>
Aug 15 13:35:46 user nova-compute[72863]:     </nova:instance>
Aug 15 13:35:46 user nova-compute[72863]:   </metadata>
Aug 15 13:35:46 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:35:46 user nova-compute[72863]:     <system>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="serial">72be1636-81d7-4811-9a3f-c96ecb86d232</entry>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="uuid">72be1636-81d7-4811-9a3f-c96ecb86d232</entry>
Aug 15 13:35:46 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:35:46 user nova-compute[72863]:     </system>
Aug 15 13:35:46 user nova-compute[72863]:   </sysinfo>
Aug 15 13:35:46 user nova-compute[72863]:   <os>
Aug 15 13:35:46 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:35:46 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:35:46 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:35:46 user nova-compute[72863]:   </os>
Aug 15 13:35:46 user nova-compute[72863]:   <features>
Aug 15 13:35:46 user nova-compute[72863]:     <acpi/>
Aug 15 13:35:46 user nova-compute[72863]:     <apic/>
Aug 15 13:35:46 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:35:46 user nova-compute[72863]:   </features>
Aug 15 13:35:46 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:35:46 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:35:46 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:35:46 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:35:46 user nova-compute[72863]:   </clock>
Aug 15 13:35:46 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:35:46 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:35:46 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:35:46 user nova-compute[72863]:   </cpu>
Aug 15 13:35:46 user nova-compute[72863]:   <devices>
Aug 15 13:35:46 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:35:46 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:35:46 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk"/>
Aug 15 13:35:46 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:35:46 user nova-compute[72863]:     </disk>
Aug 15 13:35:46 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:35:46 user nova-compute[72863]:       <mac address="fa:16:3e:83:f4:31"/>
Aug 15 13:35:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:35:46 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:35:46 user nova-compute[72863]:       <target dev="tap848f962e-34"/>
Aug 15 13:35:46 user nova-compute[72863]:     </interface>
Aug 15 13:35:46 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:35:46 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/console.log" append="off"/>
Aug 15 13:35:46 user nova-compute[72863]:     </serial>
Aug 15 13:35:46 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:35:46 user nova-compute[72863]:     <video>
Aug 15 13:35:46 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:35:46 user nova-compute[72863]:     </video>
Aug 15 13:35:46 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:35:46 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:35:46 user nova-compute[72863]:     </rng>
Aug 15 13:35:46 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:35:46 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:35:46 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:35:46 user nova-compute[72863]:     </memballoon>
Aug 15 13:35:46 user nova-compute[72863]:   </devices>
Aug 15 13:35:46 user nova-compute[72863]: </domain>
Aug 15 13:35:46 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1796833898',display_name='tempest-VolumesActionsTest-instance-1796833898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1796833898',id=35,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2496c50b62d47b191bd4a38de5232a8',ramdisk_id='',reservation_id='r-rhu4vppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-195647813',owner_user_name='tempest-VolumesActionsTest-195647813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:35:44Z,user_data=None,user_id='9193958f2cc9463fa7efcbbf9948c99a',uuid=72be1636-81d7-4811-9a3f-c96ecb86d232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converting VIF {"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_vif [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap848f962e-34, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap848f962e-34, col_values=(('external_ids', {'iface-id': '848f962e-34a0-4648-9e4b-cac8d037c6c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:f4:31', 'vm-uuid': '72be1636-81d7-4811-9a3f-c96ecb86d232'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91560621-2692-40c0-8809-1d8cb913544c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:35:46 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:46 user nova-compute[72863]: INFO os_vif [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34')
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e23177-1461-4f8b-88bd-2d73496fccdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6] added
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f7c2ee-903c-49f4-b4fe-74a0ae701ffc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] No VIF found with MAC fa:16:3e:83:f4:31, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c6a6b-13fd-4b2c-9fa5-24c87588968a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYuWVPpw {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYuWVPpw" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1add1d-e52b-4237-b1c7-540c20269705]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYuWVPpw'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf456dc-6323-4150-993b-bd6108eb65a6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee0893-7ef8-4f69-b473-6d6414d196bb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a220a-0b7c-42e5-915b-d33e5bf380da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260]
Aug 15 13:35:46 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be4c42d-c9ef-42ea-bff0-e811b1ea205a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf699fa-dc92-47cf-a295-200c1f4b1964]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:46 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Updated VIF entry in instance network info cache for port 848f962e-34a0-4648-9e4b-cac8d037c6c9. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Updating instance_info_cache with network_info: [{"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e379b1-0d7d-457a-a47a-d735bba33d48]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYuWVPpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:35:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e09a4000-3912-4839-b1e8-968eb61223cd req-9b3a5174-37bc-43f8-8146-728b0f8bda13 service nova] Releasing lock "refresh_cache-72be1636-81d7-4811-9a3f-c96ecb86d232" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23838653061633238', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838653061633238', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:35:47 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:47 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:47 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:35:47 user nova-compute[72863]:   <serial>619d5f54-b63a-4410-8825-9261f97675a6</serial>
Aug 15 13:35:47 user nova-compute[72863]: </disk>
Aug 15 13:35:47 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] No waiting events found dispatching network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:47 user nova-compute[72863]: WARNING nova.compute.manager [req-94ccd6cb-9739-496e-97cf-0df74507567e req-1a3e90a1-31e0-4796-bc69-3cea74fbcd89 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received unexpected event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 for instance with vm_state building and task_state spawning.
Aug 15 13:35:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] No VIF found with MAC fa:16:3e:65:88:fb, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-94ce6f70-deb9-475b-ac3c-f5b1611cfce9 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.881s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:49 user nova-compute[72863]: INFO nova.compute.manager [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Detaching volume ad8027b5-3def-4974-9e58-294b2d6f074b
Aug 15 13:35:49 user nova-compute[72863]: INFO nova.virt.block_device [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attempting to driver detach volume ad8027b5-3def-4974-9e58-294b2d6f074b from mountpoint /dev/vdb
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Attempting to detach device vdb from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:49 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:49 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:35:49 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:49 user nova-compute[72863]:   <serial>ad8027b5-3def-4974-9e58-294b2d6f074b</serial>
Aug 15 13:35:49 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:35:49 user nova-compute[72863]: </disk>
Aug 15 13:35:49 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdb from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the persistent domain config.
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:49 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:49 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:35:49 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:35:49 user nova-compute[72863]:   <serial>ad8027b5-3def-4974-9e58-294b2d6f074b</serial>
Aug 15 13:35:49 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:35:49 user nova-compute[72863]: </disk>
Aug 15 13:35:49 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106549.5466309, 0a6ea5f3-c240-4483-8aaa-2da3a772e634 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:35:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdb from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the live domain config.
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkJnGwlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:49 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547ae48-7110-42d6-a85e-8455a30c186a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7de6d0-7072-4f26-97c4-75aca6e9b64d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b (non-flash)
Aug 15 13:35:49 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5243f23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c710523c-8644-42d6-aaef-98d01a5919b7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d209cf-baa5-4c4c-8cc2-7f6be49424e5]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33686b-b0a2-4c19-b1b1-0592f59ba81d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be566573-0cd8-4e2b-bb6e-a6ffebc1a0d7]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c040e-a329-4efe-85a2-8c6126195fe8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b7a2e-86b0-4c64-9768-80cc99da3ae5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260]
Aug 15 13:35:49 user nova-compute[72863]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:49 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8027b5-3def-4974-9e58-294b2d6f074b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9516cb2d-ccce-4055-a071-a8da992413cc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== disconnect_volume: return (307ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] No waiting events found dispatching network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:50 user nova-compute[72863]: WARNING nova.compute.manager [req-aa9f1002-6052-4928-8a45-5ebec29b3cf7 req-c7b0885e-a0f9-454b-958a-a39fe5003ff5 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received unexpected event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 for instance with vm_state building and task_state spawning.
Aug 15 13:35:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106550.3467863, 72be1636-81d7-4811-9a3f-c96ecb86d232 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] VM Resumed (Lifecycle Event)
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Instance spawned successfully.
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106550.3483255, 72be1636-81d7-4811-9a3f-c96ecb86d232 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] VM Started (Lifecycle Event)
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Took 7.13 seconds to build instance.
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-07efbe70-cff6-44d1-8b04-b7897da0534b tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.276s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0b6961a-d272-4b91-9a59-2877b2c725a2 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:50 user nova-compute[72863]: INFO nova.compute.manager [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Terminating instance
Aug 15 13:35:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:35:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-unplugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] No waiting events found dispatching network-vif-unplugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-2906cf9d-c32d-4d96-a629-71bc43ed5b1b req-3979df3b-486f-4760-9cb9-1f22f7b68788 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-unplugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Instance destroyed successfully.
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'resources' on Instance uuid cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368834085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368834085',id=16,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-w6y5610b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:28:25Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=cfcc0d13-26ff-4bcd-aac0-d74f9df157c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "address": "fa:16:3e:70:b6:89", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6d23de8-d0", "ovs_interfaceid": "d6d23de8-d0d4-41eb-979d-2492125ccb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG os_vif [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6d23de8-d0, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:51 user nova-compute[72863]: INFO os_vif [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:89,bridge_name='br-int',has_traffic_filtering=True,id=d6d23de8-d0d4-41eb-979d-2492125ccb33,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6d23de8-d0')
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Deleting instance files /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6_del
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Deletion of /opt/stack/data/nova/instances/cfcc0d13-26ff-4bcd-aac0-d74f9df157c6_del complete
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.compute.manager [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Detaching volume 619d5f54-b63a-4410-8825-9261f97675a6
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.compute.manager [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 13:35:51 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.virt.block_device [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Attempting to driver detach volume 619d5f54-b63a-4410-8825-9261f97675a6 from mountpoint /dev/vdc
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Attempting to detach device vdc from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:51 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:51 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:51 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:35:51 user nova-compute[72863]:   <serial>619d5f54-b63a-4410-8825-9261f97675a6</serial>
Aug 15 13:35:51 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:35:51 user nova-compute[72863]: </disk>
Aug 15 13:35:51 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdc from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the persistent domain config.
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:35:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:35:51 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:35:51 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:35:51 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:35:51 user nova-compute[72863]:   <serial>619d5f54-b63a-4410-8825-9261f97675a6</serial>
Aug 15 13:35:51 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:35:51 user nova-compute[72863]: </disk>
Aug 15 13:35:51 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106552.0744915, 0a6ea5f3-c240-4483-8aaa-2da3a772e634 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:35:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully detached device vdc from instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 from the live domain config.
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYuWVPpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:35:52 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c726a6c-f8a2-4b77-9306-85f3a2ad45b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b6c5f-d0d1-4435-80c6-21c50bd2fdc0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 (non-flash)
Aug 15 13:35:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5307d0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:35:52 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Took 0.59 seconds to deallocate network for instance.
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-9b0f08d0-6792-4299-af49-96d2bb210798 req-4713c011-88ad-4d7c-b275-180f125d8726 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-deleted-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f787f-cda3-4596-907b-5561270542fa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef533b-39da-4b9b-9d5d-e7607d6fea08]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[593318f6-9127-431d-98de-a7b3e56f1f0a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cca607-6104-4508-8cf0-9355e862f604]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c918d-f901-4583-8082-4d7463ce3057]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296f7ae-e3b3-4dc8-a691-759976fd5458]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260]
Aug 15 13:35:52 user nova-compute[72863]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6, portal: 172.16.0.220,3260] successful.
Aug 15 13:35:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619d5f54-b63a-4410-8825-9261f97675a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb3ab39-8704-4390-8778-cb405f792a00]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] <== disconnect_volume: return (362ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:52 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Deleted allocations for instance cfcc0d13-26ff-4bcd-aac0-d74f9df157c6
Aug 15 13:35:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-29d23041-24b3-44f9-ab06-c4129d7273c6 tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] Acquiring lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] Lock "cfcc0d13-26ff-4bcd-aac0-d74f9df157c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] No waiting events found dispatching network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:53 user nova-compute[72863]: WARNING nova.compute.manager [req-ac2f98e5-150c-4fbc-8369-715f56236986 req-8fbcc180-414b-4b78-a744-4c683b726dc5 service nova] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Received unexpected event network-vif-plugged-d6d23de8-d0d4-41eb-979d-2492125ccb33 for instance with vm_state deleted and task_state None.
Aug 15 13:35:53 user nova-compute[72863]: DEBUG nova.objects.instance [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'flavor' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-59588aec-2b49-4ef4-b6cd-dee7c51d815f tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.836s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:54 user nova-compute[72863]: INFO nova.compute.manager [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Terminating instance
Aug 15 13:35:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Instance destroyed successfully.
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lazy-loading 'resources' on Instance uuid 0a6ea5f3-c240-4483-8aaa-2da3a772e634 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-862584300',display_name='tempest-AttachVolumeTestJSON-server-862584300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-862584300',id=32,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XfP1wQl4J4eYKU0PQae6tySilcZRjqtqNamqDBCW/LepdC+F0N3Cn25KcyLTNnwXPBHj6Q0UisMuZwZX4TuGc9E3/FaV/QUlR8BYpCWVEXUhxMszWHpYBi0DuRVsCfQ==',key_name='tempest-keypair-344133341',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='974e84d7fd49440bb0449944cc4ffa94',ramdisk_id='',reservation_id='r-w7es447f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1527183200',owner_user_name='tempest-AttachVolumeTestJSON-1527183200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acc0646305654477852de0c8bdebce90',uuid=0a6ea5f3-c240-4483-8aaa-2da3a772e634,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converting VIF {"id": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "address": "fa:16:3e:65:88:fb", "network": {"id": "c271ba7a-398f-401b-8363-03d8ca813cf3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915427297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974e84d7fd49440bb0449944cc4ffa94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617c3d83-7a", "ovs_interfaceid": "617c3d83-7a55-40cb-ba1b-cee74c49cfcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG os_vif [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617c3d83-7a, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:55 user nova-compute[72863]: INFO os_vif [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:88:fb,bridge_name='br-int',has_traffic_filtering=True,id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc,network=Network(c271ba7a-398f-401b-8363-03d8ca813cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617c3d83-7a')
Aug 15 13:35:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Deleting instance files /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634_del
Aug 15 13:35:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Deletion of /opt/stack/data/nova/instances/0a6ea5f3-c240-4483-8aaa-2da3a772e634_del complete
Aug 15 13:35:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:35:55 user nova-compute[72863]: INFO nova.compute.manager [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-unplugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] No waiting events found dispatching network-vif-unplugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-unplugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Acquiring lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] No waiting events found dispatching network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:35:55 user nova-compute[72863]: WARNING nova.compute.manager [req-de0eb0a2-1716-43d8-a3f4-db10debd160d req-fda4e6c0-3554-45be-a814-3b06276e38f9 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received unexpected event network-vif-plugged-617c3d83-7a55-40cb-ba1b-cee74c49cfcc for instance with vm_state active and task_state deleting.
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:56 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Took 0.93 seconds to deallocate network for instance.
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-ed93f2d9-4290-4fa4-9416-2393674e2548 req-e8150b78-e1cf-4dd1-bb2f-583c58721e08 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Received event network-vif-deleted-617c3d83-7a55-40cb-ba1b-cee74c49cfcc {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:35:56 user nova-compute[72863]: INFO nova.compute.manager [req-ed93f2d9-4290-4fa4-9416-2393674e2548 req-e8150b78-e1cf-4dd1-bb2f-583c58721e08 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Neutron deleted interface 617c3d83-7a55-40cb-ba1b-cee74c49cfcc; detaching it from the instance and deleting it from the info cache
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-ed93f2d9-4290-4fa4-9416-2393674e2548 req-e8150b78-e1cf-4dd1-bb2f-583c58721e08 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-ed93f2d9-4290-4fa4-9416-2393674e2548 req-e8150b78-e1cf-4dd1-bb2f-583c58721e08 service nova] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Detach interface failed, port_id=617c3d83-7a55-40cb-ba1b-cee74c49cfcc, reason: Instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:35:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:35:56 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Deleted allocations for instance 0a6ea5f3-c240-4483-8aaa-2da3a772e634
Aug 15 13:35:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-11f7450f-dea3-4073-a21d-59d05a524260 tempest-AttachVolumeTestJSON-1527183200 tempest-AttachVolumeTestJSON-1527183200-project-member] Lock "0a6ea5f3-c240-4483-8aaa-2da3a772e634" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:36:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:06 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106551.4490643, cfcc0d13-26ff-4bcd-aac0-d74f9df157c6 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:06 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] VM Stopped (Lifecycle Event)
Aug 15 13:36:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-048c7bee-2696-4d32-827e-15eadfff401e None None] [instance: cfcc0d13-26ff-4bcd-aac0-d74f9df157c6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106555.0058281, 0a6ea5f3-c240-4483-8aaa-2da3a772e634 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:10 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] VM Stopped (Lifecycle Event)
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1728a589-7ff2-44e1-a3c1-f8d3ebd893c8 None None] [instance: 0a6ea5f3-c240-4483-8aaa-2da3a772e634] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-changed-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Refreshing instance network info cache due to event network-changed-27128c94-1fa1-4e40-b068-fe4190877afb. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] Acquiring lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] Acquired lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Refreshing network info cache for port 27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updated VIF entry in instance network info cache for port 27128c94-1fa1-4e40-b068-fe4190877afb. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updating instance_info_cache with network_info: [{"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-10e418d6-517f-4bc0-a715-1be241fe111f req-5b51beed-9c34-40bd-9b4c-c5396803fbe8 service nova] Releasing lock "refresh_cache-e4081ef7-9eae-42ab-ae5a-698dba6e3723" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:11 user nova-compute[72863]: INFO nova.compute.manager [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Terminating instance
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-unplugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] No waiting events found dispatching network-vif-unplugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-237b8070-c818-475e-a2a8-0a7fc5b80950 req-ad61c294-44ec-4d70-a34d-4136beaad3a5 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-unplugged-27128c94-1fa1-4e40-b068-fe4190877afb for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:36:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Instance destroyed successfully.
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.objects.instance [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid e4081ef7-9eae-42ab-ae5a-698dba6e3723 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1560677776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1560677776',id=34,image_ref='74f65b3c-b8d1-4420-8e36-39ea61c78558',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcw3qK2E9qGBQKtLnRX6fJdR/sRLVMJyRmL596ukzqs1ze3rsUEfF7q7SDUYIbY13ZQNf5Cho7SVmrKJ7GI31I+EVobA7qNm33YMRnjR/UEdHtHyMwrT342UT5mRBiDjw==',key_name='tempest-keypair-1918344676',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-1o67tdfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1735501215',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=e4081ef7-9eae-42ab-ae5a-698dba6e3723,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "27128c94-1fa1-4e40-b068-fe4190877afb", "address": "fa:16:3e:1b:cc:87", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27128c94-1f", "ovs_interfaceid": "27128c94-1fa1-4e40-b068-fe4190877afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_vif [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27128c94-1f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:36:11 user nova-compute[72863]: INFO os_vif [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=27128c94-1fa1-4e40-b068-fe4190877afb,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27128c94-1f')
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvUVGclF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:36:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d05b8-8a81-4c1f-a353-524157688b48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22cab60-d796-46ac-970f-1ffa1d3ec381]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:36:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a10f1b4-38a8-4745-b214-f3b2443785d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:11 user nova-compute[72863]: INFO nova.compute.manager [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Terminating instance
Aug 15 13:36:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:36:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3bbdaa-373f-43bc-8bb3-1598263d3c9b]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98eb06c-975e-4dec-9aff-3bde73985394]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.088s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3346aa-46d2-43a7-b9d3-3d991d630a29]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a9f64-6fad-4fc5-8bf1-8a7a9a799999]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6647e501-a46f-4254-83c9-59c823a8d065]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260]
Aug 15 13:36:12 user nova-compute[72863]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1, portal: 172.16.0.220,3260] successful.
Aug 15 13:36:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b389c-fca3-406b-b0de-4e07f76685ed]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (422ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Deleting instance files /opt/stack/data/nova/instances/e4081ef7-9eae-42ab-ae5a-698dba6e3723_del
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Deletion of /opt/stack/data/nova/instances/e4081ef7-9eae-42ab-ae5a-698dba6e3723_del complete
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.compute.manager [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Instance destroyed successfully.
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'resources' on Instance uuid 246b401a-83c6-40d0-8f30-95af5cbebc35 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1730135285',display_name='tempest-ServerActionsTestOtherA-server-1888390326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1730135285',id=26,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABwMlpNOlVP6VR4Ghe45g/0Uha0y98axCQYAVUUrFaPyLeyhH4aF/fpFU/HDCFMVSxFXBOnKkMGKgIu6qUZfJoKzal1g38vrtsrs9fp0JwMw/FwzoUkqCFpDSrsLjSXfA==',key_name='tempest-keypair-1120465127',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-9o001rjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=246b401a-83c6-40d0-8f30-95af5cbebc35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "address": "fa:16:3e:ce:b8:7e", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec0c786-08", "ovs_interfaceid": "1ec0c786-08d0-44f6-8c5d-4e4fb3665d79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG os_vif [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec0c786-08, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:36:12 user nova-compute[72863]: INFO os_vif [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b8:7e,bridge_name='br-int',has_traffic_filtering=True,id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec0c786-08')
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Deleting instance files /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35_del
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Deletion of /opt/stack/data/nova/instances/246b401a-83c6-40d0-8f30-95af5cbebc35_del complete
Aug 15 13:36:12 user nova-compute[72863]: INFO nova.compute.manager [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 13:36:12 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:36:12 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Acquiring lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] No waiting events found dispatching network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:13 user nova-compute[72863]: WARNING nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received unexpected event network-vif-plugged-27128c94-1fa1-4e40-b068-fe4190877afb for instance with vm_state active and task_state deleting.
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-unplugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Acquiring lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] No waiting events found dispatching network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:13 user nova-compute[72863]: WARNING nova.compute.manager [req-7887b7d1-aef0-456a-98e1-423230b56656 req-40c98054-bae5-4974-93a4-754c8b8c1e91 service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received unexpected event network-vif-plugged-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 for instance with vm_state active and task_state deleting.
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:13 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Took 1.47 seconds to deallocate network for instance.
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:13 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Took 1.07 seconds to deallocate network for instance.
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-174f8d22-73c1-42ac-9979-64434cdd78ed req-011ce751-adc1-4764-87ea-5074afa9c34f service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Received event network-vif-deleted-1ec0c786-08d0-44f6-8c5d-4e4fb3665d79 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:13 user nova-compute[72863]: INFO nova.compute.manager [req-174f8d22-73c1-42ac-9979-64434cdd78ed req-011ce751-adc1-4764-87ea-5074afa9c34f service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Neutron deleted interface 1ec0c786-08d0-44f6-8c5d-4e4fb3665d79; detaching it from the instance and deleting it from the info cache
Aug 15 13:36:13 user nova-compute[72863]: DEBUG nova.network.neutron [req-174f8d22-73c1-42ac-9979-64434cdd78ed req-011ce751-adc1-4764-87ea-5074afa9c34f service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-174f8d22-73c1-42ac-9979-64434cdd78ed req-011ce751-adc1-4764-87ea-5074afa9c34f service nova] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Detach interface failed, port_id=1ec0c786-08d0-44f6-8c5d-4e4fb3665d79, reason: Instance 246b401a-83c6-40d0-8f30-95af5cbebc35 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:14 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Deleted allocations for instance 246b401a-83c6-40d0-8f30-95af5cbebc35
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e00e2b24-38d2-435d-b6f3-c165313960ce tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "246b401a-83c6-40d0-8f30-95af5cbebc35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.589s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:14 user nova-compute[72863]: INFO nova.compute.manager [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 13:36:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Deleting volume: 3d5a0732-d9e1-4acc-96a7-7f813b33b5d1 {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:15 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:36:15 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:36:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:15 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance e4081ef7-9eae-42ab-ae5a-698dba6e3723
Aug 15 13:36:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-49f75b89-4ef4-44bb-8cdd-5ac048332f86 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "e4081ef7-9eae-42ab-ae5a-698dba6e3723" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.224s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-5f46555e-a2de-474d-a925-082aa57a27d4 req-ac9e9857-c4f3-494e-8465-450cfcee852f service nova] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Received event network-vif-deleted-27128c94-1fa1-4e40-b068-fe4190877afb {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.013s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:36:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:36:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:36:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:36:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7101MB free_disk=25.45123291015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d711289a-8c75-40fc-a55b-c0d6478b664f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72be1636-81d7-4811-9a3f-c96ecb86d232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:36:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:36:26 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106571.8238933, e4081ef7-9eae-42ab-ae5a-698dba6e3723 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:26 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] VM Stopped (Lifecycle Event)
Aug 15 13:36:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8670ba87-0690-4759-8d38-0f43f74a0d20 None None] [instance: e4081ef7-9eae-42ab-ae5a-698dba6e3723] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:27 user nova-compute[72863]: INFO nova.compute.manager [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Terminating instance
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106572.77103, 246b401a-83c6-40d0-8f30-95af5cbebc35 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:27 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] VM Stopped (Lifecycle Event)
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-657a2384-0c61-4d15-b759-a78a7ded4f50 None None] [instance: 246b401a-83c6-40d0-8f30-95af5cbebc35] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-unplugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] No waiting events found dispatching network-vif-unplugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-23b8d59d-0208-4471-a767-8cb7095e08c9 req-ca7e9493-da59-4ffc-b5da-cf45bae7739a service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-unplugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Instance destroyed successfully.
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.objects.instance [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lazy-loading 'resources' on Instance uuid d711289a-8c75-40fc-a55b-c0d6478b664f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-377827314',display_name='tempest-AttachVolumeNegativeTest-server-377827314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-377827314',id=33,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATm72fO1HnqDxrWy5J+sftOPZL6wXrvusEaU26uNWtN4Dr3X8LRmKH7pLZNpfmDA5UXF0xDH5X9QXqt/kXSKmhLK0vLhTVaEnWfj1q9kxIYs2V73w2iQKS7CyYqWrkQAg==',key_name='tempest-keypair-2012086526',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f776a79a5746ae840d47da420daedc',ramdisk_id='',reservation_id='r-fpq7nyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1688916020',owner_user_name='tempest-AttachVolumeNegativeTest-1688916020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e68128a64baa4eb89f1454f94115ae1c',uuid=d711289a-8c75-40fc-a55b-c0d6478b664f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converting VIF {"id": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "address": "fa:16:3e:00:1b:cd", "network": {"id": "a66f0881-4de6-4067-81bc-28732af85104", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1852545644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f776a79a5746ae840d47da420daedc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2502b77b-30", "ovs_interfaceid": "2502b77b-30d7-4125-a5cf-8e88e33e9017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG os_vif [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2502b77b-30, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:36:28 user nova-compute[72863]: INFO os_vif [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1b:cd,bridge_name='br-int',has_traffic_filtering=True,id=2502b77b-30d7-4125-a5cf-8e88e33e9017,network=Network(a66f0881-4de6-4067-81bc-28732af85104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2502b77b-30')
Aug 15 13:36:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Deleting instance files /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f_del
Aug 15 13:36:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Deletion of /opt/stack/data/nova/instances/d711289a-8c75-40fc-a55b-c0d6478b664f_del complete
Aug 15 13:36:28 user nova-compute[72863]: INFO nova.compute.manager [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 13:36:28 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:36:28 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:29 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Took 1.01 seconds to deallocate network for instance.
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-64751c8b-be93-4bbd-9724-0f00ebc1bc33 req-35adbd66-50d1-4e83-a956-baac08f83970 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-deleted-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:29 user nova-compute[72863]: INFO nova.compute.manager [req-64751c8b-be93-4bbd-9724-0f00ebc1bc33 req-35adbd66-50d1-4e83-a956-baac08f83970 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Neutron deleted interface 2502b77b-30d7-4125-a5cf-8e88e33e9017; detaching it from the instance and deleting it from the info cache
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-64751c8b-be93-4bbd-9724-0f00ebc1bc33 req-35adbd66-50d1-4e83-a956-baac08f83970 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-64751c8b-be93-4bbd-9724-0f00ebc1bc33 req-35adbd66-50d1-4e83-a956-baac08f83970 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Detach interface failed, port_id=2502b77b-30d7-4125-a5cf-8e88e33e9017, reason: Instance d711289a-8c75-40fc-a55b-c0d6478b664f could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:29 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Deleted allocations for instance d711289a-8c75-40fc-a55b-c0d6478b664f
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] Acquiring lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] No waiting events found dispatching network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:29 user nova-compute[72863]: WARNING nova.compute.manager [req-2f469795-5bd1-45ce-a32d-945550619bdc req-c0f1a0b8-ef04-4825-b815-3de61cfbbf46 service nova] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Received unexpected event network-vif-plugged-2502b77b-30d7-4125-a5cf-8e88e33e9017 for instance with vm_state deleted and task_state None.
Aug 15 13:36:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-afe5f252-5490-4ea4-9de1-228152ce9833 tempest-AttachVolumeNegativeTest-1688916020 tempest-AttachVolumeNegativeTest-1688916020-project-member] Lock "d711289a-8c75-40fc-a55b-c0d6478b664f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [{"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-314a7b77-4fbc-4184-add3-7f1e44aa7b0f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:36:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:36:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:36 user nova-compute[72863]: INFO nova.compute.manager [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Unrescuing
Aug 15 13:36:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:36:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:36:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'flavor' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:37 user nova-compute[72863]: DEBUG nova.compute.manager [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:37 user nova-compute[72863]: WARNING nova.compute.manager [req-94ace5e2-6656-472a-80c4-08b8f015dad8 req-958ca4d8-738d-4415-ba88-898dbeb0068a service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:36:38 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance destroyed successfully.
Aug 15 13:36:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-changed-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing instance network info cache due to event network-changed-f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing network info cache for port f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updated VIF entry in instance network info cache for port f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-changed-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing instance network info cache due to event network-changed-f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquiring lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquired lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Refreshing network info cache for port f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updated VIF entry in instance network info cache for port f33b5663-b6a2-42b9-a763-22743af05207. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.network.neutron [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [{"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Releasing lock "refresh_cache-f6b53ea3-4cde-4488-b15e-52d522ac557e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:40 user nova-compute[72863]: WARNING nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:40 user nova-compute[72863]: WARNING nova.compute.manager [req-b4cac0b2-3d6f-4a0d-b312-581df241bcf4 req-ac97a30d-1a80-477e-802f-d3833de52b53 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:41 user nova-compute[72863]: INFO nova.compute.manager [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Terminating instance
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for f6b53ea3-4cde-4488-b15e-52d522ac557e due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106601.8101726, f6b53ea3-4cde-4488-b15e-52d522ac557e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Resumed (Lifecycle Event)
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e0c9b452-b4bb-4126-8d30-bbdec807551a tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:36:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106601.8130171, f6b53ea3-4cde-4488-b15e-52d522ac557e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Started (Lifecycle Event)
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-unplugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] No waiting events found dispatching network-vif-unplugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-d21c255c-37f5-40be-8c07-6607493bdea3 req-5eb3b2e1-437c-4d62-966a-86d445fc1cc1 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-unplugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:42 user nova-compute[72863]: WARNING nova.compute.manager [req-00bea0b2-c9a3-48f6-b32c-e23ad22943b5 req-c6128abd-588c-4798-8ec1-63542d5995f4 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state active and task_state None.
Aug 15 13:36:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Instance destroyed successfully.
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lazy-loading 'resources' on Instance uuid 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-826603017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-826603017',id=2,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03e9e6721b634d2fb974f7a10c6e0359',ramdisk_id='',reservation_id='r-ed39xesz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-603513238',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:24:32Z,user_data=None,user_id='f28612e758464797a56a4b7ea233ae66',uuid=1a9cffc0-83f3-4b49-82ea-0ec0f88db18d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converting VIF {"id": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "address": "fa:16:3e:d2:6d:19", "network": {"id": "dbd208f6-b6e6-43a3-a0b8-ed0281360e99", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1117145030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03e9e6721b634d2fb974f7a10c6e0359", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ff427ca-49", "ovs_interfaceid": "4ff427ca-49ff-41ba-b2e8-99d9f437dce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG os_vif [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ff427ca-49, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:36:42 user nova-compute[72863]: INFO os_vif [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9,network=Network(dbd208f6-b6e6-43a3-a0b8-ed0281360e99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ff427ca-49')
Aug 15 13:36:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Deleting instance files /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d_del
Aug 15 13:36:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Deletion of /opt/stack/data/nova/instances/1a9cffc0-83f3-4b49-82ea-0ec0f88db18d_del complete
Aug 15 13:36:42 user nova-compute[72863]: INFO nova.compute.manager [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 13:36:42 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:36:42 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:43 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Took 0.56 seconds to deallocate network for instance.
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-98408221-22ad-429f-9a06-fbad4ce4336f req-02e24940-2116-4691-805f-967de4c54b04 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-deleted-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:43 user nova-compute[72863]: INFO nova.compute.manager [req-98408221-22ad-429f-9a06-fbad4ce4336f req-02e24940-2116-4691-805f-967de4c54b04 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Neutron deleted interface 4ff427ca-49ff-41ba-b2e8-99d9f437dce9; detaching it from the instance and deleting it from the info cache
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.network.neutron [req-98408221-22ad-429f-9a06-fbad4ce4336f req-02e24940-2116-4691-805f-967de4c54b04 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-98408221-22ad-429f-9a06-fbad4ce4336f req-02e24940-2116-4691-805f-967de4c54b04 service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Detach interface failed, port_id=4ff427ca-49ff-41ba-b2e8-99d9f437dce9, reason: Instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106588.3527677, d711289a-8c75-40fc-a55b-c0d6478b664f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:43 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] VM Stopped (Lifecycle Event)
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4e880f13-de9e-4de5-9f5a-6e97a6caf1b3 None None] [instance: d711289a-8c75-40fc-a55b-c0d6478b664f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:43 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Deleted allocations for instance 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86c67dec-e96d-40c7-9754-a2d6ff11966e tempest-ServerBootFromVolumeStableRescueTest-603513238 tempest-ServerBootFromVolumeStableRescueTest-603513238-project-member] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] Acquiring lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] Lock "1a9cffc0-83f3-4b49-82ea-0ec0f88db18d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:36:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] No waiting events found dispatching network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:36:43 user nova-compute[72863]: WARNING nova.compute.manager [req-9e61cba9-7162-43c9-98a4-e9948baca273 req-40c02090-3529-4d15-a658-d6217b10c32a service nova] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Received unexpected event network-vif-plugged-4ff427ca-49ff-41ba-b2e8-99d9f437dce9 for instance with vm_state deleted and task_state None.
Aug 15 13:36:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:36:57 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106602.4225078, 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:36:57 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] VM Stopped (Lifecycle Event)
Aug 15 13:36:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-088943c0-4126-4bb0-926a-239d95fd3b75 None None] [instance: 1a9cffc0-83f3-4b49-82ea-0ec0f88db18d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:36:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:37:03 user nova-compute[72863]: INFO nova.compute.claims [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Claim successful on node user
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:37:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.policy [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ca7fc8e0234907a0c702f5058880f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5389f772e56e4039a074a8df8ba6cb05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:37:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Creating image(s)
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk 1073741824" returned: 0 in 0.051s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Successfully created port: 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.234s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Cannot resize image /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Ensure instance console log exists: /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Successfully updated port: 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing instance network info cache due to event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:37:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.neutron [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance network_info: |[{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start _get_guest_xml network_info=[{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:37:06 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:37:06 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906475110',display_name='tempest-ServerRescueNegativeTestJSON-server-906475110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906475110',id=36,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3/CqsNPoLblksgHnuWpdXH+xAyL0IHv44zA5f9nnCLKIbUnXVKTiCDOiTq6SEg8ncJw8VJ72shN0w1YFN/X1YdGCJ6SW2mUjtQbI9DdjrN7z3/oxGBOoasMMfOGmSYiQ==',key_name='tempest-keypair-675175048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-yjqop5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=e57ff0bd-4ddf-4e61-9908-52a7e51119df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:37:06 user nova-compute[72863]:   <uuid>e57ff0bd-4ddf-4e61-9908-52a7e51119df</uuid>
Aug 15 13:37:06 user nova-compute[72863]:   <name>instance-00000024</name>
Aug 15 13:37:06 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:37:06 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:37:06 user nova-compute[72863]:   <metadata>
Aug 15 13:37:06 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:37:06 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-906475110</nova:name>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:37:06</nova:creationTime>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:37:06 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:37:06 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:owner>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:37:06 user nova-compute[72863]:       </nova:owner>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:37:06 user nova-compute[72863]:       <nova:ports>
Aug 15 13:37:06 user nova-compute[72863]:         <nova:port uuid="4c8561a9-4df1-452d-9fcd-9c8d14f30bd4">
Aug 15 13:37:06 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:37:06 user nova-compute[72863]:         </nova:port>
Aug 15 13:37:06 user nova-compute[72863]:       </nova:ports>
Aug 15 13:37:06 user nova-compute[72863]:     </nova:instance>
Aug 15 13:37:06 user nova-compute[72863]:   </metadata>
Aug 15 13:37:06 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:37:06 user nova-compute[72863]:     <system>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="serial">e57ff0bd-4ddf-4e61-9908-52a7e51119df</entry>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="uuid">e57ff0bd-4ddf-4e61-9908-52a7e51119df</entry>
Aug 15 13:37:06 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:37:06 user nova-compute[72863]:     </system>
Aug 15 13:37:06 user nova-compute[72863]:   </sysinfo>
Aug 15 13:37:06 user nova-compute[72863]:   <os>
Aug 15 13:37:06 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:37:06 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:37:06 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:37:06 user nova-compute[72863]:   </os>
Aug 15 13:37:06 user nova-compute[72863]:   <features>
Aug 15 13:37:06 user nova-compute[72863]:     <acpi/>
Aug 15 13:37:06 user nova-compute[72863]:     <apic/>
Aug 15 13:37:06 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:37:06 user nova-compute[72863]:   </features>
Aug 15 13:37:06 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:37:06 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:37:06 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:37:06 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:37:06 user nova-compute[72863]:   </clock>
Aug 15 13:37:06 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:37:06 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:37:06 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:37:06 user nova-compute[72863]:   </cpu>
Aug 15 13:37:06 user nova-compute[72863]:   <devices>
Aug 15 13:37:06 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:37:06 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:37:06 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk"/>
Aug 15 13:37:06 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:37:06 user nova-compute[72863]:     </disk>
Aug 15 13:37:06 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:37:06 user nova-compute[72863]:       <mac address="fa:16:3e:d5:02:f7"/>
Aug 15 13:37:06 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:37:06 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:37:06 user nova-compute[72863]:       <target dev="tap4c8561a9-4d"/>
Aug 15 13:37:06 user nova-compute[72863]:     </interface>
Aug 15 13:37:06 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:37:06 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/console.log" append="off"/>
Aug 15 13:37:06 user nova-compute[72863]:     </serial>
Aug 15 13:37:06 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:37:06 user nova-compute[72863]:     <video>
Aug 15 13:37:06 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:37:06 user nova-compute[72863]:     </video>
Aug 15 13:37:06 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:37:06 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:37:06 user nova-compute[72863]:     </rng>
Aug 15 13:37:06 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:37:06 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:37:06 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:37:06 user nova-compute[72863]:     </memballoon>
Aug 15 13:37:06 user nova-compute[72863]:   </devices>
Aug 15 13:37:06 user nova-compute[72863]: </domain>
Aug 15 13:37:06 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906475110',display_name='tempest-ServerRescueNegativeTestJSON-server-906475110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906475110',id=36,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3/CqsNPoLblksgHnuWpdXH+xAyL0IHv44zA5f9nnCLKIbUnXVKTiCDOiTq6SEg8ncJw8VJ72shN0w1YFN/X1YdGCJ6SW2mUjtQbI9DdjrN7z3/oxGBOoasMMfOGmSYiQ==',key_name='tempest-keypair-675175048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-yjqop5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=e57ff0bd-4ddf-4e61-9908-52a7e51119df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG os_vif [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c8561a9-4d, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c8561a9-4d, col_values=(('external_ids', {'iface-id': '4c8561a9-4df1-452d-9fcd-9c8d14f30bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:02:f7', 'vm-uuid': 'e57ff0bd-4ddf-4e61-9908-52a7e51119df'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:06 user nova-compute[72863]: INFO os_vif [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d')
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:d5:02:f7, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updated VIF entry in instance network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6c5ad0bb-b7c3-4b38-889a-3030d223a6b4 req-32a78e68-d57c-4f44-b5e4-eda07219ffd1 service nova] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:06 user nova-compute[72863]: INFO nova.compute.manager [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Terminating instance
Aug 15 13:37:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:37:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-unplugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] No waiting events found dispatching network-vif-unplugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-3c75edd5-f734-4376-9ac1-94a67ef77153 req-339c9a2a-650c-48fb-a073-c653cc9612a0 service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-unplugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:07 user nova-compute[72863]: WARNING nova.compute.manager [req-e7c91610-2090-4e78-bb85-750a83797df7 req-0e11bd49-e32b-47b6-a1d0-4c0e4bfc11a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state building and task_state spawning.
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Instance destroyed successfully.
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.objects.instance [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1335362405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1335362405',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKot62ZOMZduor4DCFn7hTFSh1KDePpoEwuLNAPRHWbsQ0smdlRnRtuT5juPBb85kgv36Mgh50UBD9iLWUIK0Rwd/iCDtAVY+OGDrn7ec9XW2efnTBERyyvtoydbpHkdiA==',key_name='tempest-keypair-1389449953',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-onew3d92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "address": "fa:16:3e:03:1a:a5", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53d3ea7-fe", "ovs_interfaceid": "f53d3ea7-feb7-4e56-b28b-74e26e418800", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_vif [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf53d3ea7-fe, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:08 user nova-compute[72863]: INFO os_vif [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1a:a5,bridge_name='br-int',has_traffic_filtering=True,id=f53d3ea7-feb7-4e56-b28b-74e26e418800,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53d3ea7-fe')
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwDTdRnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:37:08 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e23691-a924-4540-82d8-097aa96f8cc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb00d3-b840-43d9-8993-295ee43413fc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:37:08 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:37:08 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b (non-flash)
Aug 15 13:37:08 user nova-compute[72863]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:37:08 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff524301ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b'): ({'sde'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sde {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[964735b0-64ee-4d0c-929e-cfcc83490f94]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.033s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37b532-fb0a-43c7-bc45-1371aa887c86]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sde {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6a73c-6fda-4b55-8db3-892ad72a6c55]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbccf1-cea7-4f29-9a3e-ec4bfd9bca54]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4c877-2c1c-437c-b6f8-7fc49b71dc35]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f21e4c-c48c-49ca-9a58-2bfa5209cf14]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260]
Aug 15 13:37:08 user nova-compute[72863]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b, portal: 172.16.0.220,3260] successful.
Aug 15 13:37:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7abe1e2-86d3-45e3-bad4-9be6c758589b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fa603e-f030-473e-8f47-f7980f7d9089]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (330ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:37:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Deleting instance files /opt/stack/data/nova/instances/2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd_del
Aug 15 13:37:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Deletion of /opt/stack/data/nova/instances/2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd_del complete
Aug 15 13:37:08 user nova-compute[72863]: INFO nova.compute.manager [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Took 1.74 seconds to destroy the instance on the hypervisor.
Aug 15 13:37:08 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:37:08 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] Acquiring lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] No waiting events found dispatching network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:09 user nova-compute[72863]: WARNING nova.compute.manager [req-e38cfb2f-3aef-4720-b553-57bf63cdc56e req-8d717120-144b-4ec3-a966-5cd3954b0b5e service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received unexpected event network-vif-plugged-f53d3ea7-feb7-4e56-b28b-74e26e418800 for instance with vm_state active and task_state deleting.
Aug 15 13:37:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:09 user nova-compute[72863]: WARNING nova.compute.manager [req-15c57804-dbf3-4f89-a7f0-65515b7ffa71 req-7db864f3-b16e-46cb-9765-59cfbf0e3e01 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state building and task_state spawning.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Detaching volume d7efbfde-b00d-46b8-9dcd-b6397ae06096
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.virt.block_device [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Attempting to driver detach volume d7efbfde-b00d-46b8-9dcd-b6397ae06096 from mountpoint /dev/vdb
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Attempting to detach device vdb from instance f6b53ea3-4cde-4488-b15e-52d522ac557e from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:37:10 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:37:10 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:37:10 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:37:10 user nova-compute[72863]:   <serial>d7efbfde-b00d-46b8-9dcd-b6397ae06096</serial>
Aug 15 13:37:10 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:37:10 user nova-compute[72863]: </disk>
Aug 15 13:37:10 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Successfully detached device vdb from instance f6b53ea3-4cde-4488-b15e-52d522ac557e from the persistent domain config.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6b53ea3-4cde-4488-b15e-52d522ac557e from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:37:10 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:37:10 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:37:10 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:37:10 user nova-compute[72863]:   <serial>d7efbfde-b00d-46b8-9dcd-b6397ae06096</serial>
Aug 15 13:37:10 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:37:10 user nova-compute[72863]: </disk>
Aug 15 13:37:10 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106630.344117, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Resumed (Lifecycle Event)
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance spawned successfully.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Took 1.82 seconds to deallocate network for instance.
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106630.3549142, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Started (Lifecycle Event)
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.compute.manager [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Took 7.57 seconds to build instance.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ddeca64a-da46-468c-9145-b9505360e510 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.668s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106630.8123887, f6b53ea3-4cde-4488-b15e-52d522ac557e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:37:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Successfully detached device vdb from instance f6b53ea3-4cde-4488-b15e-52d522ac557e from the live domain config.
Aug 15 13:37:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkFiuRgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:37:10 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6583091-08a9-40f8-bdb4-13a15e61c9c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea0a68-bab8-4c0e-b8bf-543ee77aaae9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:37:10 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:10 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 (non-flash)
Aug 15 13:37:10 user nova-compute[72863]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:10 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c102290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096'): ({'sdg'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Removing single pathed devices sdg {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db7f27-087e-441a-b55b-573333703051]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c50da-9f77-47c7-987f-04eb37181d78]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Flushing IO for device /dev/sdg {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b55b9f-4037-4083-bd61-d472fd53318d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:37:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e7846-338d-4c98-be85-d7409a3461d1]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[033943ce-dcbd-4892-a113-858d4fbd4306]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f0876-3d28-4e11-82f7-a56ed2f2e14a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260]
Aug 15 13:37:11 user nova-compute[72863]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096, portal: 172.16.0.220,3260] successful.
Aug 15 13:37:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7efbfde-b00d-46b8-9dcd-b6397ae06096 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e363e-d0e8-4c26-b098-0a83f4cea19f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] <== disconnect_volume: return (357ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:37:11 user nova-compute[72863]: INFO nova.compute.manager [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 13:37:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Deleting volume: c7abe1e2-86d3-45e3-bad4-9be6c758589b {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:11 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd
Aug 15 13:37:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-28f8d609-2511-4601-90a9-790638d88ccd tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.948s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-5654011d-bbe4-4f94-adc6-88c70beca2ea req-3e6b67c3-b12f-4154-9671-c5eaa901b48f service nova] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Received event network-vif-deleted-f53d3ea7-feb7-4e56-b28b-74e26e418800 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'flavor' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7a5439a9-0497-46aa-8f40-8b9b3d70b6eb tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.921s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106628.183717, 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:37:23 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] VM Stopped (Lifecycle Event)
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG nova.compute.manager [None req-45715049-fc88-4a83-83a8-ae68f31f2a0e None None] [instance: 2e3f307f-b2a6-4f32-bbb0-0f6127a7a5bd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:37:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=25.552101135253906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 212b0da2-d0da-4920-b26a-f7143ae7840f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f6b53ea3-4cde-4488-b15e-52d522ac557e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 72be1636-81d7-4811-9a3f-c96ecb86d232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:37:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:30 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:37:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:37:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:36 user nova-compute[72863]: INFO nova.compute.manager [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Terminating instance
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-0898d34c-317f-4ead-bee1-496b1f36620b req-0ac751fa-a4d1-4d69-be83-dd9c8f81f2a7 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-unplugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:37:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Instance destroyed successfully.
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lazy-loading 'resources' on Instance uuid 314a7b77-4fbc-4184-add3-7f1e44aa7b0f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1841832683',display_name='tempest-ServerActionsTestOtherB-server-1841832683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1841832683',id=22,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUZj3F89eeXtCksuBxJ1D8FkRvYjI5BtCH9vGSbWOGXpHefJri4MSW5MCqzG2Y6wCaRwPeoyqhxgWzb7YgOZjSlwTjj+HW/+rcoMv3Ggiq+ulejDBYAL/88CG5Uo8OoSg==',key_name='tempest-keypair-1834822939',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfea57273354f118f2cdc6734d0d796',ramdisk_id='',reservation_id='r-ukz3chfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-852730704',owner_user_name='tempest-ServerActionsTestOtherB-852730704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c38ea4a412d4cb8ad2e8b7f89c3d5c4',uuid=314a7b77-4fbc-4184-add3-7f1e44aa7b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converting VIF {"id": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "address": "fa:16:3e:ca:73:dd", "network": {"id": "d11d9a02-5a2e-425c-a8fc-976c588a5e78", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-801687522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfea57273354f118f2cdc6734d0d796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa249e220-f1", "ovs_interfaceid": "a249e220-f1eb-4dee-9aaf-f12953a48bbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG os_vif [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa249e220-f1, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:36 user nova-compute[72863]: INFO os_vif [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:73:dd,bridge_name='br-int',has_traffic_filtering=True,id=a249e220-f1eb-4dee-9aaf-f12953a48bbd,network=Network(d11d9a02-5a2e-425c-a8fc-976c588a5e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa249e220-f1')
Aug 15 13:37:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtuRhwFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:37:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:37:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:37:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d6fbf-4c9b-4311-9038-667e53e11419]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a134541-48f8-4fb1-bbfa-3defb07e6f66]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 (non-flash)
Aug 15 13:37:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c3a3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878'): ({'sdf'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Removing single pathed devices sdf {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bacc521-d30f-48fb-98a0-93927c7d1df1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c53f8-737c-4d8a-85d2-08c6e31661ec]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Flushing IO for device /dev/sdf {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8fad8b-dfa2-44b1-97f6-f58dfcfab57c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d7b73-bec8-414e-80fb-e7b615522a41]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d958b9-81fd-4103-a1f0-4ee0ae8b1146]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4feac44-68de-491c-9f13-4f9d7788b8ef]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260]
Aug 15 13:37:37 user nova-compute[72863]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878, portal: 172.16.0.220,3260] successful.
Aug 15 13:37:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f71a2a31-755b-42f6-8597-460e62faa878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7548c1e-9ec7-4e81-a00c-fba4bbaaa921]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] <== disconnect_volume: return (292ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:37:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Deleting instance files /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_del
Aug 15 13:37:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Deletion of /opt/stack/data/nova/instances/314a7b77-4fbc-4184-add3-7f1e44aa7b0f_del complete
Aug 15 13:37:37 user nova-compute[72863]: INFO nova.compute.manager [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 15 13:37:37 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:37:37 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:38 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Took 0.90 seconds to deallocate network for instance.
Aug 15 13:37:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-6c3f24c4-d6f1-4a2c-bf4e-4f6901a6f369 req-3ad05144-ed75-46af-84b7-ca1330c8fae3 service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-deleted-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] Acquiring lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] No waiting events found dispatching network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:38 user nova-compute[72863]: WARNING nova.compute.manager [req-feb0f13c-c838-440b-b602-a3660a98341d req-8e33f91d-b8ce-474f-b595-da6b72d3cc9c service nova] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Received unexpected event network-vif-plugged-a249e220-f1eb-4dee-9aaf-f12953a48bbd for instance with vm_state active and task_state deleting.
Aug 15 13:37:39 user nova-compute[72863]: INFO nova.compute.manager [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 13:37:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:39 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:39 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:39 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Deleted allocations for instance 314a7b77-4fbc-4184-add3-7f1e44aa7b0f
Aug 15 13:37:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1135a2f-5e15-486b-b332-6ab5c0223019 tempest-ServerActionsTestOtherB-852730704 tempest-ServerActionsTestOtherB-852730704-project-member] Lock "314a7b77-4fbc-4184-add3-7f1e44aa7b0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:40 user nova-compute[72863]: INFO nova.compute.manager [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Terminating instance
Aug 15 13:37:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-unplugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] No waiting events found dispatching network-vif-unplugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-c8b8f149-cb65-4725-8dcf-955c5ddbc0ae req-99435439-7959-458b-b9d2-3c655553b332 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-unplugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:37:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Instance destroyed successfully.
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lazy-loading 'resources' on Instance uuid 212b0da2-d0da-4920-b26a-f7143ae7840f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1645964417',display_name='tempest-ServersNegativeTestJSON-server-1645964417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1645964417',id=21,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baba30e66ae4f9bad5a891c97ac4650',ramdisk_id='',reservation_id='r-6ldlf6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2047494063',owner_user_name='tempest-ServersNegativeTestJSON-2047494063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:28:51Z,user_data=None,user_id='9fed10e3f5c747719e8894168cdc5546',uuid=212b0da2-d0da-4920-b26a-f7143ae7840f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converting VIF {"id": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "address": "fa:16:3e:4f:ea:d0", "network": {"id": "2e582ead-557d-4c02-9c46-a057e7f8a0dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1723775482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baba30e66ae4f9bad5a891c97ac4650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70c24af-75", "ovs_interfaceid": "c70c24af-7528-4cc6-aa5b-51c4aaa23bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG os_vif [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc70c24af-75, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:41 user nova-compute[72863]: INFO os_vif [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:ea:d0,bridge_name='br-int',has_traffic_filtering=True,id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf,network=Network(2e582ead-557d-4c02-9c46-a057e7f8a0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70c24af-75')
Aug 15 13:37:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Deleting instance files /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f_del
Aug 15 13:37:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Deletion of /opt/stack/data/nova/instances/212b0da2-d0da-4920-b26a-f7143ae7840f_del complete
Aug 15 13:37:41 user nova-compute[72863]: INFO nova.compute.manager [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 13:37:41 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:37:41 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-8caee94a-b4c5-447f-af4e-b1b468844870 req-db0b2eee-aa2f-4489-be99-abced10d066f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-deleted-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:42 user nova-compute[72863]: INFO nova.compute.manager [req-8caee94a-b4c5-447f-af4e-b1b468844870 req-db0b2eee-aa2f-4489-be99-abced10d066f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Neutron deleted interface c70c24af-7528-4cc6-aa5b-51c4aaa23bcf; detaching it from the instance and deleting it from the info cache
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.network.neutron [req-8caee94a-b4c5-447f-af4e-b1b468844870 req-db0b2eee-aa2f-4489-be99-abced10d066f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:42 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Took 0.61 seconds to deallocate network for instance.
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-8caee94a-b4c5-447f-af4e-b1b468844870 req-db0b2eee-aa2f-4489-be99-abced10d066f service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Detach interface failed, port_id=c70c24af-7528-4cc6-aa5b-51c4aaa23bcf, reason: Instance 212b0da2-d0da-4920-b26a-f7143ae7840f could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:42 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Deleted allocations for instance 212b0da2-d0da-4920-b26a-f7143ae7840f
Aug 15 13:37:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-1bb415cf-fb2c-4ea2-b0c6-564ed91d051b tempest-ServersNegativeTestJSON-2047494063 tempest-ServersNegativeTestJSON-2047494063-project-member] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] Acquiring lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] Lock "212b0da2-d0da-4920-b26a-f7143ae7840f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] No waiting events found dispatching network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:43 user nova-compute[72863]: WARNING nova.compute.manager [req-90d73cf3-a790-43e6-971d-fdd2039b1c1c req-a840c37f-2429-4650-9fdf-93984d74d452 service nova] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Received unexpected event network-vif-plugged-c70c24af-7528-4cc6-aa5b-51c4aaa23bcf for instance with vm_state deleted and task_state None.
Aug 15 13:37:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:47 user nova-compute[72863]: INFO nova.compute.manager [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Terminating instance
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-unplugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] No waiting events found dispatching network-vif-unplugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-7077d0c0-1676-46ed-b518-57c027e0ae1d req-2fb7897b-f8bd-41f8-ad4c-40ab2ddd47ee service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-unplugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:37:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Instance destroyed successfully.
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lazy-loading 'resources' on Instance uuid 72be1636-81d7-4811-9a3f-c96ecb86d232 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1796833898',display_name='tempest-VolumesActionsTest-instance-1796833898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1796833898',id=35,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2496c50b62d47b191bd4a38de5232a8',ramdisk_id='',reservation_id='r-rhu4vppz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-195647813',owner_user_name='tempest-VolumesActionsTest-195647813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:35:51Z,user_data=None,user_id='9193958f2cc9463fa7efcbbf9948c99a',uuid=72be1636-81d7-4811-9a3f-c96ecb86d232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converting VIF {"id": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "address": "fa:16:3e:83:f4:31", "network": {"id": "2efda0db-5541-4e0b-97bb-1358ab7b8cc8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-408612055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2496c50b62d47b191bd4a38de5232a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848f962e-34", "ovs_interfaceid": "848f962e-34a0-4648-9e4b-cac8d037c6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG os_vif [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap848f962e-34, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:37:47 user nova-compute[72863]: INFO os_vif [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=848f962e-34a0-4648-9e4b-cac8d037c6c9,network=Network(2efda0db-5541-4e0b-97bb-1358ab7b8cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap848f962e-34')
Aug 15 13:37:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Deleting instance files /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232_del
Aug 15 13:37:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Deletion of /opt/stack/data/nova/instances/72be1636-81d7-4811-9a3f-c96ecb86d232_del complete
Aug 15 13:37:47 user nova-compute[72863]: INFO nova.compute.manager [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 13:37:47 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:37:47 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:37:48 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:37:48 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Took 0.78 seconds to deallocate network for instance.
Aug 15 13:37:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:49 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Deleted allocations for instance 72be1636-81d7-4811-9a3f-c96ecb86d232
Aug 15 13:37:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-41885569-af59-4b81-aa28-54f4aecaa7e5 tempest-VolumesActionsTest-195647813 tempest-VolumesActionsTest-195647813-project-member] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] Acquiring lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] Lock "72be1636-81d7-4811-9a3f-c96ecb86d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:37:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] No waiting events found dispatching network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:37:49 user nova-compute[72863]: WARNING nova.compute.manager [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received unexpected event network-vif-plugged-848f962e-34a0-4648-9e4b-cac8d037c6c9 for instance with vm_state deleted and task_state None.
Aug 15 13:37:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-a5440689-0ed5-45db-ae43-af78cea790d3 req-df0740ce-f571-4bec-b08c-d71e77566048 service nova] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Received event network-vif-deleted-848f962e-34a0-4648-9e4b-cac8d037c6c9 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:37:51 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106656.9291787, 314a7b77-4fbc-4184-add3-7f1e44aa7b0f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:37:51 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] VM Stopped (Lifecycle Event)
Aug 15 13:37:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-faed65d0-066a-4056-9905-39321438fbaf None None] [instance: 314a7b77-4fbc-4184-add3-7f1e44aa7b0f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:37:56 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106661.6555922, 212b0da2-d0da-4920-b26a-f7143ae7840f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:37:56 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] VM Stopped (Lifecycle Event)
Aug 15 13:37:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d3a0d130-2f2a-474b-9ef6-5d5f98b0fcc6 None None] [instance: 212b0da2-d0da-4920-b26a-f7143ae7840f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:37:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:00 user nova-compute[72863]: INFO nova.compute.manager [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Terminating instance
Aug 15 13:38:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-ecf6d14f-6e8e-4de6-9e48-1371c5a21a34 req-76ba37d4-b4dc-4521-9b47-0fc8f8413da8 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-unplugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:38:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Instance destroyed successfully.
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.objects.instance [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lazy-loading 'resources' on Instance uuid f6b53ea3-4cde-4488-b15e-52d522ac557e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:30:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-545359356',display_name='tempest-ServerStableDeviceRescueTest-server-545359356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-545359356',id=29,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlwyH2myAPySn5x6PNkp2gpy5J2NL3Uyat6gEr8HGloj1v2tnIcad8iCfPcZCFitHnYRkj35+HXQO7njTkU3ciMsVD7GnbEiuyJMA/SjXMCmdM57pZro2H9qLP7LLvojA==',key_name='tempest-keypair-858193593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:34:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffea36ec1e34d8fa6c4c9c66fc4a8da',ramdisk_id='',reservation_id='r-wnc2l5je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1470876027',owner_user_name='tempest-ServerStableDeviceRescueTest-1470876027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6d22cd35c54349868cd6ecacc7340c',uuid=f6b53ea3-4cde-4488-b15e-52d522ac557e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converting VIF {"id": "f33b5663-b6a2-42b9-a763-22743af05207", "address": "fa:16:3e:0d:0c:af", "network": {"id": "c9975d8c-4057-42fc-8b59-ec071d610179", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1336757619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffea36ec1e34d8fa6c4c9c66fc4a8da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33b5663-b6", "ovs_interfaceid": "f33b5663-b6a2-42b9-a763-22743af05207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG os_vif [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33b5663-b6, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:38:01 user nova-compute[72863]: INFO os_vif [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0c:af,bridge_name='br-int',has_traffic_filtering=True,id=f33b5663-b6a2-42b9-a763-22743af05207,network=Network(c9975d8c-4057-42fc-8b59-ec071d610179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33b5663-b6')
Aug 15 13:38:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Deleting instance files /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e_del
Aug 15 13:38:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Deletion of /opt/stack/data/nova/instances/f6b53ea3-4cde-4488-b15e-52d522ac557e_del complete
Aug 15 13:38:01 user nova-compute[72863]: INFO nova.compute.manager [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 13:38:01 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:38:01 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:38:02 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:02 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Took 1.10 seconds to deallocate network for instance.
Aug 15 13:38:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-01f64b01-ed4e-4af4-afa0-07b80bd4294e req-4b301982-6816-4e5d-8a96-299e81809b67 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-deleted-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:02 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106667.8832264, 72be1636-81d7-4811-9a3f-c96ecb86d232 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:02 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] VM Stopped (Lifecycle Event)
Aug 15 13:38:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-db0f829e-14fb-4133-9bb0-61d0dffe201f None None] [instance: 72be1636-81d7-4811-9a3f-c96ecb86d232] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:03 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Deleted allocations for instance f6b53ea3-4cde-4488-b15e-52d522ac557e
Aug 15 13:38:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] Acquiring lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] No waiting events found dispatching network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:03 user nova-compute[72863]: WARNING nova.compute.manager [req-b004743a-61c3-4da2-b56a-6d43c4f91d1f req-60657d93-5eab-4ada-bf20-2850e9bc97b9 service nova] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Received unexpected event network-vif-plugged-f33b5663-b6a2-42b9-a763-22743af05207 for instance with vm_state deleted and task_state None.
Aug 15 13:38:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-518e3d5a-45cd-4db5-8387-a22a0857bed9 tempest-ServerStableDeviceRescueTest-1470876027 tempest-ServerStableDeviceRescueTest-1470876027-project-member] Lock "f6b53ea3-4cde-4488-b15e-52d522ac557e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:38:11 user nova-compute[72863]: INFO nova.compute.claims [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Claim successful on node user
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:38:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:38:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG nova.policy [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:38:12 user nova-compute[72863]: INFO nova.virt.block_device [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Booting with volume 44d69130-ff8d-4c4b-adad-c4b517a5b76c at /dev/vda
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.utils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ac2a7-a6b2-4c9a-9a5e-01fae4965a47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37deea27-7f5b-45ef-9deb-0415e2b63aeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fa011a-0cb4-4eba-bc7a-e06498e69d23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1173d82f-c852-4943-b32b-89bfd5af7aed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:12 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:38:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b593d-257f-47c8-bae1-612d5e38feb3]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG os_brick.utils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updating existing volume attachment record: 04095d40-357e-4a64-9a79-eb0872bc2c72 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:38:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Successfully created port: 085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Successfully updated port: 085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-changed-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Refreshing instance network info cache due to event network-changed-085f6c4e-16ca-4784-b6bf-18bb08d2de60. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] Acquiring lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updating instance_info_cache with network_info: [{"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Instance network_info: |[{"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] Acquired lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.network.neutron [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Refreshing network info cache for port 085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.network.neutron [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updated VIF entry in instance network info cache for port 085f6c4e-16ca-4784-b6bf-18bb08d2de60. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.network.neutron [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updating instance_info_cache with network_info: [{"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e0a57089-e2c1-467d-99f2-2d33252e48b4 req-6198ec42-f920-4cc7-ab7f-ca713e4bd203 service nova] Releasing lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:38:15 user nova-compute[72863]: INFO nova.compute.claims [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Claim successful on node user
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:38:15 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:38:15 user nova-compute[72863]: INFO nova.virt.block_device [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Booting with volume 57a6558f-1e75-4d13-b8af-7214e69eff08 at /dev/vda
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.policy [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd885a5f78b6e4c3c993fee958bee7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8a87964e7845cba898b18f2d5021ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.utils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f019f89-3203-4837-b37c-69aab68a9d63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[277cdf95-ccb8-48d5-b4a2-488852644643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43a40fd-7ad6-4a25-8465-380dbb871fdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8662e-fd68-4daf-bb59-9f2d4641af58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:15 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:38:15 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a5ba4-5824-4fa5-a6f2-0cd1855a234c]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG os_brick.utils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:38:15 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating existing volume attachment record: cefc6deb-4b37-4448-93d3-aa2717882415 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:38:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Successfully created port: a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:38:16 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106681.5924034, f6b53ea3-4cde-4488-b15e-52d522ac557e => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:16 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] VM Stopped (Lifecycle Event)
Aug 15 13:38:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3336cbe1-6602-4811-ba67-2e1237f4ef3b None None] [instance: f6b53ea3-4cde-4488-b15e-52d522ac557e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Successfully updated port: a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-changed-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Refreshing instance network info cache due to event network-changed-a339be36-1094-4a39-98fb-16669d43a54d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:38:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance network_info: |[{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Refreshing network info cache for port a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updated VIF entry in instance network info cache for port a339be36-1094-4a39-98fb-16669d43a54d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG nova.network.neutron [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d7e3add4-1db9-4bfe-80e6-b2cdb7b5c6b5 req-e30fb70d-318b-423e-b1ed-a01a26776347 service nova] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:38:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Creating image(s)
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Ensure instance console log exists: /opt/stack/data/nova/instances/37fbb78f-5384-4b98-bf2c-b54423083f56/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Start _get_guest_xml network_info=[{"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '04095d40-357e-4a64-9a79-eb0872bc2c72', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37fbb78f-5384-4b98-bf2c-b54423083f56', 'attached_at': '', 'detached_at': '', 'volume_id': '44d69130-ff8d-4c4b-adad-c4b517a5b76c', 'serial': '44d69130-ff8d-4c4b-adad-c4b517a5b76c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:38:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:38:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:38:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:38:22 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba858dfd-cc0c-4579-801e-2f1fca7e31f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:38:22 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68dc0ad-521b-4f9e-a3d2-54ff0e840b8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c] added
Aug 15 13:38:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b559d0d-3694-4687-9157-2e0cff2ff057]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c14f8e9-4867-4c60-b005-e5dd25e86344]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFowmKsJ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFowmKsJ" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c11f49-52c8-4a8e-8a15-3b3d6eb6465e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFowmKsJ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b0966-6ecb-4d76-ab04-16fab6eeab30]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1638a75b-94ee-4a31-9179-fb87b6671b38]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:38:22 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:38:22 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:38:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:38:22 user nova-compute[72863]: 
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8433ec62-adb8-47e3-af6e-2af67c3774c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]
Aug 15 13:38:22 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.
Aug 15 13:38:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8281eed2-cdc4-40a7-a3cd-0b23dded894d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[19528341-65ed-4486-8e48-025e8c0cd7cb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba899f54-40d7-429c-a5c3-c42e6f95138e]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.687s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1688ms) {'type': 'block', 'scsi_wwn': '23131623335636335', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623335636335', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:38:23 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:23 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8073MB free_disk=25.718082427978516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401295823',display_name='tempest-TestVolumeBootPattern-server-401295823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401295823',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-pyalxla2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:38:12Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=37fbb78f-5384-4b98-bf2c-b54423083f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid 37fbb78f-5384-4b98-bf2c-b54423083f56 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:38:23 user nova-compute[72863]:   <uuid>37fbb78f-5384-4b98-bf2c-b54423083f56</uuid>
Aug 15 13:38:23 user nova-compute[72863]:   <name>instance-00000025</name>
Aug 15 13:38:23 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:38:23 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:38:23 user nova-compute[72863]:   <metadata>
Aug 15 13:38:23 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:38:23 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:38:23 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-server-401295823</nova:name>
Aug 15 13:38:23 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:38:22</nova:creationTime>
Aug 15 13:38:23 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:38:23 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:38:23 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:38:23 user nova-compute[72863]:       <nova:owner>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:38:23 user nova-compute[72863]:       </nova:owner>
Aug 15 13:38:23 user nova-compute[72863]:       <nova:ports>
Aug 15 13:38:23 user nova-compute[72863]:         <nova:port uuid="085f6c4e-16ca-4784-b6bf-18bb08d2de60">
Aug 15 13:38:23 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 13:38:23 user nova-compute[72863]:         </nova:port>
Aug 15 13:38:23 user nova-compute[72863]:       </nova:ports>
Aug 15 13:38:23 user nova-compute[72863]:     </nova:instance>
Aug 15 13:38:23 user nova-compute[72863]:   </metadata>
Aug 15 13:38:23 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:38:23 user nova-compute[72863]:     <system>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="serial">37fbb78f-5384-4b98-bf2c-b54423083f56</entry>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="uuid">37fbb78f-5384-4b98-bf2c-b54423083f56</entry>
Aug 15 13:38:23 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:38:23 user nova-compute[72863]:     </system>
Aug 15 13:38:23 user nova-compute[72863]:   </sysinfo>
Aug 15 13:38:23 user nova-compute[72863]:   <os>
Aug 15 13:38:23 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:38:23 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:38:23 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:38:23 user nova-compute[72863]:   </os>
Aug 15 13:38:23 user nova-compute[72863]:   <features>
Aug 15 13:38:23 user nova-compute[72863]:     <acpi/>
Aug 15 13:38:23 user nova-compute[72863]:     <apic/>
Aug 15 13:38:23 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:38:23 user nova-compute[72863]:   </features>
Aug 15 13:38:23 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:38:23 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:38:23 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:38:23 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:38:23 user nova-compute[72863]:   </clock>
Aug 15 13:38:23 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:38:23 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:38:23 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:38:23 user nova-compute[72863]:   </cpu>
Aug 15 13:38:23 user nova-compute[72863]:   <devices>
Aug 15 13:38:23 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:38:23 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:38:23 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:38:23 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:38:23 user nova-compute[72863]:       <serial>44d69130-ff8d-4c4b-adad-c4b517a5b76c</serial>
Aug 15 13:38:23 user nova-compute[72863]:     </disk>
Aug 15 13:38:23 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:38:23 user nova-compute[72863]:       <mac address="fa:16:3e:7d:e4:be"/>
Aug 15 13:38:23 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:38:23 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:38:23 user nova-compute[72863]:       <target dev="tap085f6c4e-16"/>
Aug 15 13:38:23 user nova-compute[72863]:     </interface>
Aug 15 13:38:23 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:38:23 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/37fbb78f-5384-4b98-bf2c-b54423083f56/console.log" append="off"/>
Aug 15 13:38:23 user nova-compute[72863]:     </serial>
Aug 15 13:38:23 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:38:23 user nova-compute[72863]:     <video>
Aug 15 13:38:23 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:38:23 user nova-compute[72863]:     </video>
Aug 15 13:38:23 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:38:23 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:38:23 user nova-compute[72863]:     </rng>
Aug 15 13:38:23 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:38:23 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:38:23 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:38:23 user nova-compute[72863]:     </memballoon>
Aug 15 13:38:23 user nova-compute[72863]:   </devices>
Aug 15 13:38:23 user nova-compute[72863]: </domain>
Aug 15 13:38:23 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401295823',display_name='tempest-TestVolumeBootPattern-server-401295823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401295823',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-pyalxla2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:38:12Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=37fbb78f-5384-4b98-bf2c-b54423083f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG os_vif [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap085f6c4e-16, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap085f6c4e-16, col_values=(('external_ids', {'iface-id': '085f6c4e-16ca-4784-b6bf-18bb08d2de60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:e4:be', 'vm-uuid': '37fbb78f-5384-4b98-bf2c-b54423083f56'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:38:23 user nova-compute[72863]: INFO os_vif [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16')
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 37fbb78f-5384-4b98-bf2c-b54423083f56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:38:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:7d:e4:be, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:38:24 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:38:24 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:38:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:38:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] No waiting events found dispatching network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:25 user nova-compute[72863]: WARNING nova.compute.manager [req-656f0119-29d9-45ba-b757-aaf4e3e8bd31 req-99b37e03-7ce2-4b29-9be6-a26dab5aef13 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received unexpected event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 for instance with vm_state building and task_state spawning.
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106707.490338, 37fbb78f-5384-4b98-bf2c-b54423083f56 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] VM Resumed (Lifecycle Event)
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Instance spawned successfully.
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106707.493641, 37fbb78f-5384-4b98-bf2c-b54423083f56 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] VM Started (Lifecycle Event)
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] No waiting events found dispatching network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:27 user nova-compute[72863]: WARNING nova.compute.manager [req-d914f8bd-2eb6-41ae-861b-64d5481742bf req-a1bfbbcc-c67a-4a58-abba-7c59b51280be service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received unexpected event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 for instance with vm_state building and task_state spawning.
Aug 15 13:38:27 user nova-compute[72863]: INFO nova.compute.manager [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Took 16.29 seconds to build instance.
Aug 15 13:38:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e08fb809-6077-4d8f-9e03-71dda128ebee tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.576s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:38:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:38:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:38:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:38:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:38:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Creating image(s)
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Ensure instance console log exists: /opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start _get_guest_xml network_info=[{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cefc6deb-4b37-4448-93d3-aa2717882415', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c88999a3-03bb-4966-abf4-9357e936bd2e', 'attached_at': '', 'detached_at': '', 'volume_id': '57a6558f-1e75-4d13-b8af-7214e69eff08', 'serial': '57a6558f-1e75-4d13-b8af-7214e69eff08'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:38:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:38:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:38:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:38:37 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e22bc7-7e3d-41a8-a740-bc8c3b83e293]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:38:37 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[95751a49-d9e9-4619-95a9-6e80bb231d58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08] added
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76accca1-92db-46c9-b0a7-7c071eda7000]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b8fa02-a6c3-4b55-bf34-9fc3ac85ea16]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhBMCtAE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhBMCtAE" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6153d3-5094-4b99-8d2e-b02424f98b7a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhBMCtAE'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[716813ec-7fdb-4f56-95de-f734bbd74d14]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b051e41-beef-499d-a9fd-e9b1eea616b4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ca6588-a8ef-483b-97d2-79edb8478c27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]
Aug 15 13:38:37 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8875c5-580b-484a-a591-085420580175]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4389b12a-f431-43cd-8b41-8327f81675cf]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:37 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:38:37 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:38:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f4a6f-d244-4405-a1e5-0a88557eacd2]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:38:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23638313438333133', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638313438333133', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.objects.instance [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_devices' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:38:38 user nova-compute[72863]:   <uuid>c88999a3-03bb-4966-abf4-9357e936bd2e</uuid>
Aug 15 13:38:38 user nova-compute[72863]:   <name>instance-00000026</name>
Aug 15 13:38:38 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:38:38 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:38:38 user nova-compute[72863]:   <metadata>
Aug 15 13:38:38 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:38:38 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:38:38 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherA-server-546999856</nova:name>
Aug 15 13:38:38 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:38:37</nova:creationTime>
Aug 15 13:38:38 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:38:38 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:38:38 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:38:38 user nova-compute[72863]:       <nova:owner>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:user uuid="d885a5f78b6e4c3c993fee958bee7cd0">tempest-ServerActionsTestOtherA-278685911-project-member</nova:user>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:project uuid="2d8a87964e7845cba898b18f2d5021ec">tempest-ServerActionsTestOtherA-278685911</nova:project>
Aug 15 13:38:38 user nova-compute[72863]:       </nova:owner>
Aug 15 13:38:38 user nova-compute[72863]:       <nova:ports>
Aug 15 13:38:38 user nova-compute[72863]:         <nova:port uuid="a339be36-1094-4a39-98fb-16669d43a54d">
Aug 15 13:38:38 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:38:38 user nova-compute[72863]:         </nova:port>
Aug 15 13:38:38 user nova-compute[72863]:       </nova:ports>
Aug 15 13:38:38 user nova-compute[72863]:     </nova:instance>
Aug 15 13:38:38 user nova-compute[72863]:   </metadata>
Aug 15 13:38:38 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:38:38 user nova-compute[72863]:     <system>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="serial">c88999a3-03bb-4966-abf4-9357e936bd2e</entry>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="uuid">c88999a3-03bb-4966-abf4-9357e936bd2e</entry>
Aug 15 13:38:38 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:38:38 user nova-compute[72863]:     </system>
Aug 15 13:38:38 user nova-compute[72863]:   </sysinfo>
Aug 15 13:38:38 user nova-compute[72863]:   <os>
Aug 15 13:38:38 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:38:38 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:38:38 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:38:38 user nova-compute[72863]:   </os>
Aug 15 13:38:38 user nova-compute[72863]:   <features>
Aug 15 13:38:38 user nova-compute[72863]:     <acpi/>
Aug 15 13:38:38 user nova-compute[72863]:     <apic/>
Aug 15 13:38:38 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:38:38 user nova-compute[72863]:   </features>
Aug 15 13:38:38 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:38:38 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:38:38 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:38:38 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:38:38 user nova-compute[72863]:   </clock>
Aug 15 13:38:38 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:38:38 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:38:38 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:38:38 user nova-compute[72863]:   </cpu>
Aug 15 13:38:38 user nova-compute[72863]:   <devices>
Aug 15 13:38:38 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:38:38 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:38:38 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:38:38 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:38:38 user nova-compute[72863]:       <serial>57a6558f-1e75-4d13-b8af-7214e69eff08</serial>
Aug 15 13:38:38 user nova-compute[72863]:     </disk>
Aug 15 13:38:38 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:38:38 user nova-compute[72863]:       <mac address="fa:16:3e:a8:a6:22"/>
Aug 15 13:38:38 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:38:38 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:38:38 user nova-compute[72863]:       <target dev="tapa339be36-10"/>
Aug 15 13:38:38 user nova-compute[72863]:     </interface>
Aug 15 13:38:38 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:38:38 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e/console.log" append="off"/>
Aug 15 13:38:38 user nova-compute[72863]:     </serial>
Aug 15 13:38:38 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:38:38 user nova-compute[72863]:     <video>
Aug 15 13:38:38 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:38:38 user nova-compute[72863]:     </video>
Aug 15 13:38:38 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:38:38 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:38:38 user nova-compute[72863]:     </rng>
Aug 15 13:38:38 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:38:38 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:38:38 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:38:38 user nova-compute[72863]:     </memballoon>
Aug 15 13:38:38 user nova-compute[72863]:   </devices>
Aug 15 13:38:38 user nova-compute[72863]: </domain>
Aug 15 13:38:38 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG os_vif [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa339be36-10, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa339be36-10, col_values=(('external_ids', {'iface-id': 'a339be36-1094-4a39-98fb-16669d43a54d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:a6:22', 'vm-uuid': 'c88999a3-03bb-4966-abf4-9357e936bd2e'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:38 user nova-compute[72863]: INFO os_vif [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10')
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:38:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:a8:a6:22, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:40 user nova-compute[72863]: WARNING nova.compute.manager [req-52b9be95-6af8-4ea9-9f13-1cdb98b4b24c req-fe96969d-6a78-4e74-ba01-2c1b791619f7 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state building and task_state spawning.
Aug 15 13:38:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106722.6332223, c88999a3-03bb-4966-abf4-9357e936bd2e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] VM Resumed (Lifecycle Event)
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance spawned successfully.
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106722.6345258, c88999a3-03bb-4966-abf4-9357e936bd2e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] VM Started (Lifecycle Event)
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:38:42 user nova-compute[72863]: WARNING nova.compute.manager [req-870cc869-cc7c-4ed8-8159-19e3397df63f req-acad520c-8f8f-4b53-91c6-8c8deb7e0833 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state building and task_state spawning.
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 15 13:38:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:38:42 user nova-compute[72863]: INFO nova.compute.manager [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Took 27.86 seconds to build instance.
Aug 15 13:38:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6b5a74ed-4f03-4962-a2b5-1cbf187289b5 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.043s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_power_states {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 37fbb78f-5384-4b98-bf2c-b54423083f56 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "772fe730-8857-4520-9006-3972b660b933" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "772fe730-8857-4520-9006-3972b660b933" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "eb797116-28dc-481b-af43-439920b4f269" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.012s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "772fe730-8857-4520-9006-3972b660b933" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing instance network info cache due to event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG nova.network.neutron [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "eb797116-28dc-481b-af43-439920b4f269" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'flavor' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:38:55 user nova-compute[72863]: INFO nova.compute.manager [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Attaching volume b71170b8-c651-498a-90c7-7891aec16ef5 to /dev/vdb
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ad4b0-7c7a-443e-b383-8ba2ecc76d5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb2bf39-b31e-46e7-8acb-52c68ba7121a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0687b1e9-f8e1-4b42-a946-e685c75186c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updated VIF entry in instance network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[557a2937-fb66-400d-b5df-8a9066c8c582]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0a31f8ea-4d4b-4285-82ea-42c8c99a91a2 req-aedffa0a-b000-4227-98aa-be6b9c0a2fd3 service nova] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:38:55 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:38:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b0b6e-b83c-4d20-a6a1-1022bb8f3a12]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:38:55 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating existing volume attachment record: 48ac4520-3ed3-474b-b242-9a3f1d26d61b {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:38:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAqoMOlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:39:07 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:39:07 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:39:07 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf01583-d3bb-4d9a-9b4b-e0bf477a2aa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:39:07 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae5051-ba22-4548-b513-7994bdd70bfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5] added
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dcbdb2-c27d-4a4d-9665-c0370da5bd3f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e7cdd-6400-4db6-9b5f-da9261868f3c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAqoMOlW {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAqoMOlW" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a264fd-df71-4029-b07b-924b25f9f8ad]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PAqoMOlW'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef1cc58-59e0-4e17-82c5-ae94b08c7397]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e224fbc-af4c-4739-ab66-9697379e4a1c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a72c736-7fc1-4a3c-ae69-b1505f2650a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260]
Aug 15 13:39:07 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260] successful.
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af50616-1093-48fe-acfb-9c91364159c0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5fe39-8461-4428-9933-08273e78b947]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:39:07 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed9c775-9bf5-41ad-9102-e9d4a9361dd0]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:39:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAqoMOlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23837343734333033', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837343734333033', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG nova.objects.instance [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'flavor' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:39:08 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:39:08 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:39:08 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:39:08 user nova-compute[72863]:   <serial>b71170b8-c651-498a-90c7-7891aec16ef5</serial>
Aug 15 13:39:08 user nova-compute[72863]: </disk>
Aug 15 13:39:08 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:39:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:39:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:39:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:d5:02:f7, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:39:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-942aa84f-e8a8-456c-b1ce-acc9d3eaaad9 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.064s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:10 user nova-compute[72863]: INFO nova.compute.manager [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Rescuing
Aug 15 13:39:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:39:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:39:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:39:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:39:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance destroyed successfully.
Aug 15 13:39:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Attempting rescue
Aug 15 13:39:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72863) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:39:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Creating image(s)
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'trusted_certs' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue" returned: 0 in 0.071s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'migration_context' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start _get_guest_xml network_info=[{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:d5:02:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'numa_topology' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:13 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:13 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'vcpu_model' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906475110',display_name='tempest-ServerRescueNegativeTestJSON-server-906475110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906475110',id=36,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3/CqsNPoLblksgHnuWpdXH+xAyL0IHv44zA5f9nnCLKIbUnXVKTiCDOiTq6SEg8ncJw8VJ72shN0w1YFN/X1YdGCJ6SW2mUjtQbI9DdjrN7z3/oxGBOoasMMfOGmSYiQ==',key_name='tempest-keypair-675175048',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-yjqop5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=e57ff0bd-4ddf-4e61-9908-52a7e51119df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:d5:02:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "vif_mac": "fa:16:3e:d5:02:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'pci_devices' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:39:13 user nova-compute[72863]:   <uuid>e57ff0bd-4ddf-4e61-9908-52a7e51119df</uuid>
Aug 15 13:39:13 user nova-compute[72863]:   <name>instance-00000024</name>
Aug 15 13:39:13 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:39:13 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:39:13 user nova-compute[72863]:   <metadata>
Aug 15 13:39:13 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:39:13 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-906475110</nova:name>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:39:13</nova:creationTime>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:39:13 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:39:13 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:owner>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:user uuid="46ca7fc8e0234907a0c702f5058880f1">tempest-ServerRescueNegativeTestJSON-1509280722-project-member</nova:user>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:project uuid="5389f772e56e4039a074a8df8ba6cb05">tempest-ServerRescueNegativeTestJSON-1509280722</nova:project>
Aug 15 13:39:13 user nova-compute[72863]:       </nova:owner>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:39:13 user nova-compute[72863]:       <nova:ports>
Aug 15 13:39:13 user nova-compute[72863]:         <nova:port uuid="4c8561a9-4df1-452d-9fcd-9c8d14f30bd4">
Aug 15 13:39:13 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:39:13 user nova-compute[72863]:         </nova:port>
Aug 15 13:39:13 user nova-compute[72863]:       </nova:ports>
Aug 15 13:39:13 user nova-compute[72863]:     </nova:instance>
Aug 15 13:39:13 user nova-compute[72863]:   </metadata>
Aug 15 13:39:13 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:39:13 user nova-compute[72863]:     <system>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="serial">e57ff0bd-4ddf-4e61-9908-52a7e51119df</entry>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="uuid">e57ff0bd-4ddf-4e61-9908-52a7e51119df</entry>
Aug 15 13:39:13 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:39:13 user nova-compute[72863]:     </system>
Aug 15 13:39:13 user nova-compute[72863]:   </sysinfo>
Aug 15 13:39:13 user nova-compute[72863]:   <os>
Aug 15 13:39:13 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:39:13 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:39:13 user nova-compute[72863]:   </os>
Aug 15 13:39:13 user nova-compute[72863]:   <features>
Aug 15 13:39:13 user nova-compute[72863]:     <acpi/>
Aug 15 13:39:13 user nova-compute[72863]:     <apic/>
Aug 15 13:39:13 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:39:13 user nova-compute[72863]:   </features>
Aug 15 13:39:13 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:39:13 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:39:13 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:39:13 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:39:13 user nova-compute[72863]:   </clock>
Aug 15 13:39:13 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:39:13 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:39:13 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:39:13 user nova-compute[72863]:   </cpu>
Aug 15 13:39:13 user nova-compute[72863]:   <devices>
Aug 15 13:39:13 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:39:13 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:39:13 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue"/>
Aug 15 13:39:13 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:39:13 user nova-compute[72863]:     </disk>
Aug 15 13:39:13 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:39:13 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:39:13 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk"/>
Aug 15 13:39:13 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:39:13 user nova-compute[72863]:     </disk>
Aug 15 13:39:13 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:39:13 user nova-compute[72863]:       <mac address="fa:16:3e:d5:02:f7"/>
Aug 15 13:39:13 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:39:13 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:39:13 user nova-compute[72863]:       <target dev="tap4c8561a9-4d"/>
Aug 15 13:39:13 user nova-compute[72863]:     </interface>
Aug 15 13:39:13 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:39:13 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/console.log" append="off"/>
Aug 15 13:39:13 user nova-compute[72863]:     </serial>
Aug 15 13:39:13 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:39:13 user nova-compute[72863]:     <video>
Aug 15 13:39:13 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:39:13 user nova-compute[72863]:     </video>
Aug 15 13:39:13 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:39:13 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:39:13 user nova-compute[72863]:     </rng>
Aug 15 13:39:13 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:39:13 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:39:13 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:39:13 user nova-compute[72863]:     </memballoon>
Aug 15 13:39:13 user nova-compute[72863]:   </devices>
Aug 15 13:39:13 user nova-compute[72863]: </domain>
Aug 15 13:39:13 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:39:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance destroyed successfully.
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] No VIF found with MAC fa:16:3e:d5:02:f7, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:39:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:14 user nova-compute[72863]: WARNING nova.compute.manager [req-f9e48d43-0edd-4937-974a-fd8e11c3ff62 req-ff75edf8-8b76-4767-8a80-614f5e0e392f service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state active and task_state rescuing.
Aug 15 13:39:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:16 user nova-compute[72863]: WARNING nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state active and task_state rescuing.
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:16 user nova-compute[72863]: WARNING nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state active and task_state rescuing.
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:16 user nova-compute[72863]: WARNING nova.compute.manager [req-81bae6e1-b86d-439d-92aa-33eedd5a06ad req-e2428d89-0450-44ce-a33a-96b9ee71c5a5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state active and task_state rescuing.
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for e57ff0bd-4ddf-4e61-9908-52a7e51119df due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106757.4012403, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:39:17 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Resumed (Lifecycle Event)
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-26dc7fec-7f37-4344-aca2-2fe26573ebd0 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:39:17 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106757.4024484, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:39:17 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Started (Lifecycle Event)
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:39:18 user nova-compute[72863]: INFO nova.compute.claims [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Claim successful on node user
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:39:18 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:39:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.policy [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68d851d4db5542b889871f7300ad5158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9a115e03e455bb340a4b23376c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:39:19 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Creating image(s)
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.216s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.305s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk 1073741824" returned: 0 in 0.058s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Successfully created port: b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.237s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Cannot resize image /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'migration_context' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Ensure instance console log exists: /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Successfully updated port: b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing instance network info cache due to event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance network_info: |[{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.neutron [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start _get_guest_xml network_info=[{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:39:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:21 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaEQf+iv7jk+vhXRxlt2Q0EclLPUbfCDR+F70dPACTSfRNTHdUhlgA5f0w58q5C749fYLq1XadjHSUVD33KbHoj5ukGwyT2pmVVR2PGHcdMSofoXH/9GcXCTagYLkLk5Q==',key_name='tempest-keypair-1575422208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_devices' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:39:21 user nova-compute[72863]:   <uuid>85dc30ef-6273-49a4-83e6-b265c44fa76a</uuid>
Aug 15 13:39:21 user nova-compute[72863]:   <name>instance-00000027</name>
Aug 15 13:39:21 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:39:21 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:39:21 user nova-compute[72863]:   <metadata>
Aug 15 13:39:21 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:39:21 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1881959639</nova:name>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:39:21</nova:creationTime>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:39:21 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:39:21 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:owner>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:user uuid="68d851d4db5542b889871f7300ad5158">tempest-AttachVolumeShelveTestJSON-69904858-project-member</nova:user>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:project uuid="2cc9a115e03e455bb340a4b23376c4c5">tempest-AttachVolumeShelveTestJSON-69904858</nova:project>
Aug 15 13:39:21 user nova-compute[72863]:       </nova:owner>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:39:21 user nova-compute[72863]:       <nova:ports>
Aug 15 13:39:21 user nova-compute[72863]:         <nova:port uuid="b4cd9a00-f7d3-46bd-af23-d896e94a02ae">
Aug 15 13:39:21 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:39:21 user nova-compute[72863]:         </nova:port>
Aug 15 13:39:21 user nova-compute[72863]:       </nova:ports>
Aug 15 13:39:21 user nova-compute[72863]:     </nova:instance>
Aug 15 13:39:21 user nova-compute[72863]:   </metadata>
Aug 15 13:39:21 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:39:21 user nova-compute[72863]:     <system>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="serial">85dc30ef-6273-49a4-83e6-b265c44fa76a</entry>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="uuid">85dc30ef-6273-49a4-83e6-b265c44fa76a</entry>
Aug 15 13:39:21 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:39:21 user nova-compute[72863]:     </system>
Aug 15 13:39:21 user nova-compute[72863]:   </sysinfo>
Aug 15 13:39:21 user nova-compute[72863]:   <os>
Aug 15 13:39:21 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:39:21 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:39:21 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:39:21 user nova-compute[72863]:   </os>
Aug 15 13:39:21 user nova-compute[72863]:   <features>
Aug 15 13:39:21 user nova-compute[72863]:     <acpi/>
Aug 15 13:39:21 user nova-compute[72863]:     <apic/>
Aug 15 13:39:21 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:39:21 user nova-compute[72863]:   </features>
Aug 15 13:39:21 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:39:21 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:39:21 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:39:21 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:39:21 user nova-compute[72863]:   </clock>
Aug 15 13:39:21 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:39:21 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:39:21 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:39:21 user nova-compute[72863]:   </cpu>
Aug 15 13:39:21 user nova-compute[72863]:   <devices>
Aug 15 13:39:21 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:39:21 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:39:21 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk"/>
Aug 15 13:39:21 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:39:21 user nova-compute[72863]:     </disk>
Aug 15 13:39:21 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:39:21 user nova-compute[72863]:       <mac address="fa:16:3e:07:63:c0"/>
Aug 15 13:39:21 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:39:21 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:39:21 user nova-compute[72863]:       <target dev="tapb4cd9a00-f7"/>
Aug 15 13:39:21 user nova-compute[72863]:     </interface>
Aug 15 13:39:21 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:39:21 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/console.log" append="off"/>
Aug 15 13:39:21 user nova-compute[72863]:     </serial>
Aug 15 13:39:21 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:39:21 user nova-compute[72863]:     <video>
Aug 15 13:39:21 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:39:21 user nova-compute[72863]:     </video>
Aug 15 13:39:21 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:39:21 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:39:21 user nova-compute[72863]:     </rng>
Aug 15 13:39:21 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:39:21 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:39:21 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:39:21 user nova-compute[72863]:     </memballoon>
Aug 15 13:39:21 user nova-compute[72863]:   </devices>
Aug 15 13:39:21 user nova-compute[72863]: </domain>
Aug 15 13:39:21 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaEQf+iv7jk+vhXRxlt2Q0EclLPUbfCDR+F70dPACTSfRNTHdUhlgA5f0w58q5C749fYLq1XadjHSUVD33KbHoj5ukGwyT2pmVVR2PGHcdMSofoXH/9GcXCTagYLkLk5Q==',key_name='tempest-keypair-1575422208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG os_vif [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4cd9a00-f7, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4cd9a00-f7, col_values=(('external_ids', {'iface-id': 'b4cd9a00-f7d3-46bd-af23-d896e94a02ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:63:c0', 'vm-uuid': '85dc30ef-6273-49a4-83e6-b265c44fa76a'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:22 user nova-compute[72863]: INFO os_vif [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7')
Aug 15 13:39:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No VIF found with MAC fa:16:3e:07:63:c0, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updated VIF entry in instance network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:39:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a31b4bd4-9bef-47b7-85b3-d35a3c9a35e2 req-24a82f9a-a31e-4410-b943-70c69ae7d522 service nova] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:23 user nova-compute[72863]: WARNING nova.compute.manager [req-190215d7-1903-4365-8d2e-4c94362b55a8 req-e5544fab-8704-46a4-bd0c-b4fbe5518045 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state building and task_state spawning.
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:39:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:39:26 user nova-compute[72863]: WARNING nova.compute.manager [req-e16ce166-fa4a-4a8b-82b9-a3a2c31eae2d req-18b9430a-c6f9-4848-9ae4-0bc41e7c303e service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state building and task_state spawning.
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106766.43302, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Resumed (Lifecycle Event)
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance spawned successfully.
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106766.4336596, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Started (Lifecycle Event)
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:39:26 user nova-compute[72863]: INFO nova.compute.manager [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Took 8.06 seconds to build instance.
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e1e734bd-840a-455a-a4cd-abbf6e31a358 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.192s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:39:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=25.675182342529297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 37fbb78f-5384-4b98-bf2c-b54423083f56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 85dc30ef-6273-49a4-83e6-b265c44fa76a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:39:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:39:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:39:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:39:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:39:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:39:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-changed-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Refreshing instance network info cache due to event network-changed-085f6c4e-16ca-4784-b6bf-18bb08d2de60. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] Acquiring lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] Acquired lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Refreshing network info cache for port 085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updated VIF entry in instance network info cache for port 085f6c4e-16ca-4784-b6bf-18bb08d2de60. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updating instance_info_cache with network_info: [{"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-03b9dc6d-958c-4d26-a2c9-9a5da59d041d req-deef25b1-a17b-4f42-b128-83811a8baf93 service nova] Releasing lock "refresh_cache-37fbb78f-5384-4b98-bf2c-b54423083f56" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:04 user nova-compute[72863]: INFO nova.compute.manager [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Terminating instance
Aug 15 13:40:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Instance destroyed successfully.
Aug 15 13:40:05 user nova-compute[72863]: DEBUG nova.objects.instance [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid 37fbb78f-5384-4b98-bf2c-b54423083f56 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401295823',display_name='tempest-TestVolumeBootPattern-server-401295823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401295823',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:38:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-pyalxla2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:38:28Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=37fbb78f-5384-4b98-bf2c-b54423083f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "address": "fa:16:3e:7d:e4:be", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085f6c4e-16", "ovs_interfaceid": "085f6c4e-16ca-4784-b6bf-18bb08d2de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_vif [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap085f6c4e-16, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:40:05 user nova-compute[72863]: INFO os_vif [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:be,bridge_name='br-int',has_traffic_filtering=True,id=085f6c4e-16ca-4784-b6bf-18bb08d2de60,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085f6c4e-16')
Aug 15 13:40:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:40:05 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0edb012-0271-4757-8a85-1b6861cf46d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28d170-0814-49ac-a5e0-f2d8268e400e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:40:05 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:05 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:05 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:40:05 user nova-compute[72863]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:05 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:05 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff524078f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3dff66-0d35-492a-aaba-4a4a44ec7991]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df9432-fc60-46fd-a281-e03e3e2bb1c5]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530d980-8d19-45b8-918e-ca957557ea5c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:40:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df990099-acb0-4ab3-a67e-af1bb21783d4]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23131623335636335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4302bd8', '/dev/disk/by-id/scsi-1SCST_BIOe4302bd8-11b35cc5a6a2c413') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc69f6e6-c027-487a-bddf-811a672940f1]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a56ac-db5a-4d5a-88d6-b0eea7801afe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd5384-798d-4d3d-9a42-f86acdf4c544]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]
Aug 15 13:40:06 user nova-compute[72863]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.
Aug 15 13:40:06 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb18bb-9b1d-458d-9d52-6f5653f7afbe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (364ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:40:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Deleting instance files /opt/stack/data/nova/instances/37fbb78f-5384-4b98-bf2c-b54423083f56_del
Aug 15 13:40:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Deletion of /opt/stack/data/nova/instances/37fbb78f-5384-4b98-bf2c-b54423083f56_del complete
Aug 15 13:40:06 user nova-compute[72863]: INFO nova.compute.manager [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-unplugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] No waiting events found dispatching network-vif-unplugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-unplugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Acquiring lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] No waiting events found dispatching network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:06 user nova-compute[72863]: WARNING nova.compute.manager [req-55795b9e-0bc9-442b-a759-02eb04ae7e42 req-84c35509-b360-45b0-849f-c441122e1597 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received unexpected event network-vif-plugged-085f6c4e-16ca-4784-b6bf-18bb08d2de60 for instance with vm_state active and task_state deleting.
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing instance network info cache due to event network-changed-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Refreshing network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:07 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Took 1.52 seconds to deallocate network for instance.
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated VIF entry in instance network info cache for port 3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG nova.network.neutron [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11df6910-8213-433a-abde-3c2193493558 req-1c4c3b2f-1408-4490-af89-88a59411b9dd service nova] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:09 user nova-compute[72863]: INFO nova.compute.manager [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Took 1.28 seconds to detach 1 volumes for instance.
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-changed-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Refreshing instance network info cache due to event network-changed-a339be36-1094-4a39-98fb-16669d43a54d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Refreshing network info cache for port a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Stashing vm_state: active {{(pid=72863) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.269s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_requests' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:09 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance 37fbb78f-5384-4b98-bf2c-b54423083f56
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:40:09 user nova-compute[72863]: INFO nova.compute.claims [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Claim successful on node user
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'resources' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'pci_devices' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:09 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating resource usage from migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b
Aug 15 13:40:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-357b5d3f-08f9-4986-b53b-ae3d5b7e38df tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "37fbb78f-5384-4b98-bf2c-b54423083f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.837s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.584s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:10 user nova-compute[72863]: INFO nova.compute.manager [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Migrating
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updated VIF entry in instance network info cache for port a339be36-1094-4a39-98fb-16669d43a54d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-29a27057-43c9-4433-84c5-026939026abd req-6dc34495-3c31-40ea-8c8d-8c4ec3191269 service nova] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Received event network-vif-deleted-085f6c4e-16ca-4784-b6bf-18bb08d2de60 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:40:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:40:11 user nova-compute[72863]: INFO nova.compute.claims [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Claim successful on node user
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Starting migrate_disk_and_power_off {{(pid=72863) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:11 user nova-compute[72863]: WARNING nova.compute.manager [req-82067d9b-3a9a-4074-a38d-8b81372c7892 req-fcf4ba17-dd6f-405f-9fd8-9c17203a6fc8 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state active and task_state resize_migrating.
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:40:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.policy [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5547a48d79ce450aa51c27e44bc50865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031bdc2cc8f46afbc58624292c7369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:40:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Creating image(s)
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "/opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "/opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "/opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance destroyed successfully.
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG os_vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa339be36-10, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:40:11 user nova-compute[72863]: INFO os_vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10')
Aug 15 13:40:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:40:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:40:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59bd248-3dce-4e59-9511-856356f1a41c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af23ac8-4de7-4db4-9a26-1aa998f0314d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:12 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:12 user nova-compute[72863]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5243a5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9db0c0-6a55-4055-a8c8-39768f28c400]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33ce01-f32c-4446-8171-f1cc4111b649]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.238s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cfca94-e04c-499f-8a35-3c8910b6d020]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614d35a-119b-43ff-8e2b-0427d718f3c3]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ac3a259', '/dev/disk/by-id/scsi-23638313438333133', '/dev/disk/by-id/scsi-1SCST_BIO3ac3a259-68148313d3d1e1c3') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b12a3a1-6125-476b-a673-bcdfddeeeead]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b91c70-38a2-459d-834a-2d54dbafb792]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[130bd5ec-9095-4e8d-8d84-001bd47364c7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]
Aug 15 13:40:12 user nova-compute[72863]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.
Aug 15 13:40:12 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[833ad927-edfb-4cf5-b2ca-7b200a0b3d4d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== disconnect_volume: return (353ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.231s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk 1073741824" returned: 0 in 0.060s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Successfully created port: 1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Cannot resize image /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'migration_context' on Instance uuid d330e12b-b8fd-432a-9a5a-845d0df98d89 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Ensure instance console log exists: /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.compute.manager [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:13 user nova-compute[72863]: WARNING nova.compute.manager [req-5f384be4-e1f2-4c88-81b6-75ab5ba8a20f req-04ca2aa8-ec7c-4e94-abed-44df3bc86efa service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state active and task_state resize_migrating.
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Port a339be36-1094-4a39-98fb-16669d43a54d binding to destination host user is already ACTIVE {{(pid=72863) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Successfully updated port: 1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquired lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Updating instance_info_cache with network_info: [{"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Releasing lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Instance network_info: |[{"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Start _get_guest_xml network_info=[{"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:40:14 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:14 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694141962',display_name='tempest-VolumesActionsTest-instance-1694141962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694141962',id=40,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-jtzvxt71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:40:12Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=d330e12b-b8fd-432a-9a5a-845d0df98d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.objects.instance [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'pci_devices' on Instance uuid d330e12b-b8fd-432a-9a5a-845d0df98d89 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.utils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:40:14 user nova-compute[72863]:   <uuid>d330e12b-b8fd-432a-9a5a-845d0df98d89</uuid>
Aug 15 13:40:14 user nova-compute[72863]:   <name>instance-00000028</name>
Aug 15 13:40:14 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:40:14 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:40:14 user nova-compute[72863]:   <metadata>
Aug 15 13:40:14 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:40:14 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:name>tempest-VolumesActionsTest-instance-1694141962</nova:name>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:40:14</nova:creationTime>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:40:14 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:40:14 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:owner>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:user uuid="5547a48d79ce450aa51c27e44bc50865">tempest-VolumesActionsTest-1439550672-project-member</nova:user>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:project uuid="1031bdc2cc8f46afbc58624292c7369f">tempest-VolumesActionsTest-1439550672</nova:project>
Aug 15 13:40:14 user nova-compute[72863]:       </nova:owner>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:40:14 user nova-compute[72863]:       <nova:ports>
Aug 15 13:40:14 user nova-compute[72863]:         <nova:port uuid="1dc22923-7131-4387-b246-ad68db3e40b5">
Aug 15 13:40:14 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:40:14 user nova-compute[72863]:         </nova:port>
Aug 15 13:40:14 user nova-compute[72863]:       </nova:ports>
Aug 15 13:40:14 user nova-compute[72863]:     </nova:instance>
Aug 15 13:40:14 user nova-compute[72863]:   </metadata>
Aug 15 13:40:14 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:40:14 user nova-compute[72863]:     <system>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="serial">d330e12b-b8fd-432a-9a5a-845d0df98d89</entry>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="uuid">d330e12b-b8fd-432a-9a5a-845d0df98d89</entry>
Aug 15 13:40:14 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:40:14 user nova-compute[72863]:     </system>
Aug 15 13:40:14 user nova-compute[72863]:   </sysinfo>
Aug 15 13:40:14 user nova-compute[72863]:   <os>
Aug 15 13:40:14 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:40:14 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:40:14 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:40:14 user nova-compute[72863]:   </os>
Aug 15 13:40:14 user nova-compute[72863]:   <features>
Aug 15 13:40:14 user nova-compute[72863]:     <acpi/>
Aug 15 13:40:14 user nova-compute[72863]:     <apic/>
Aug 15 13:40:14 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:40:14 user nova-compute[72863]:   </features>
Aug 15 13:40:14 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:40:14 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:40:14 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:40:14 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:40:14 user nova-compute[72863]:   </clock>
Aug 15 13:40:14 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:40:14 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:40:14 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:40:14 user nova-compute[72863]:   </cpu>
Aug 15 13:40:14 user nova-compute[72863]:   <devices>
Aug 15 13:40:14 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:40:14 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:40:14 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk"/>
Aug 15 13:40:14 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:40:14 user nova-compute[72863]:     </disk>
Aug 15 13:40:14 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:40:14 user nova-compute[72863]:       <mac address="fa:16:3e:5c:aa:9f"/>
Aug 15 13:40:14 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:40:14 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:40:14 user nova-compute[72863]:       <target dev="tap1dc22923-71"/>
Aug 15 13:40:14 user nova-compute[72863]:     </interface>
Aug 15 13:40:14 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:40:14 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/console.log" append="off"/>
Aug 15 13:40:14 user nova-compute[72863]:     </serial>
Aug 15 13:40:14 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:40:14 user nova-compute[72863]:     <video>
Aug 15 13:40:14 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:40:14 user nova-compute[72863]:     </video>
Aug 15 13:40:14 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:40:14 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:40:14 user nova-compute[72863]:     </rng>
Aug 15 13:40:14 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:40:14 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:40:14 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:40:14 user nova-compute[72863]:     </memballoon>
Aug 15 13:40:14 user nova-compute[72863]:   </devices>
Aug 15 13:40:14 user nova-compute[72863]: </domain>
Aug 15 13:40:14 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694141962',display_name='tempest-VolumesActionsTest-instance-1694141962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694141962',id=40,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-jtzvxt71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:40:12Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=d330e12b-b8fd-432a-9a5a-845d0df98d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_vif [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc22923-71, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dc22923-71, col_values=(('external_ids', {'iface-id': '1dc22923-7131-4387-b246-ad68db3e40b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:aa:9f', 'vm-uuid': 'd330e12b-b8fd-432a-9a5a-845d0df98d89'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf457741-05dd-481f-8c91-d3a76fe11053]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:14 user nova-compute[72863]: INFO os_vif [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71')
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f9e58-0fa3-4d4e-b2d0-c87176b7c419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c207bb96-24ea-4f88-a884-50163297eefe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fa35ca-f5cd-40a3-8083-69c9c3ff7f4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] No VIF found with MAC fa:16:3e:5c:aa:9f, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:40:14 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:40:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f9303f-ea1b-43e4-90a7-11c09ac342cb]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:40:14 user nova-compute[72863]: DEBUG os_brick.utils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-changed-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG nova.compute.manager [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Refreshing instance network info cache due to event network-changed-1dc22923-7131-4387-b246-ad68db3e40b5. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] Acquiring lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] Acquired lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Refreshing network info cache for port 1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Updated VIF entry in instance network info cache for port 1dc22923-7131-4387-b246-ad68db3e40b5. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:40:15 user nova-compute[72863]: DEBUG nova.network.neutron [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Updating instance_info_cache with network_info: [{"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b1e77c76-c76c-4d21-8a96-efde23b097ed req-d075017b-42fb-4d02-a401-2e16b5ff187c service nova] Releasing lock "refresh_cache-d330e12b-b8fd-432a-9a5a-845d0df98d89" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] No waiting events found dispatching network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:17 user nova-compute[72863]: WARNING nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received unexpected event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 for instance with vm_state building and task_state spawning.
Aug 15 13:40:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] No waiting events found dispatching network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:17 user nova-compute[72863]: WARNING nova.compute.manager [req-2e3ee9ee-73ab-4100-af72-c0f8c192deb0 req-059d69fa-a216-4c8f-be4c-2d443baee044 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received unexpected event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 for instance with vm_state building and task_state spawning.
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106818.1873782, d330e12b-b8fd-432a-9a5a-845d0df98d89 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] VM Resumed (Lifecycle Event)
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Instance spawned successfully.
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106818.1912134, d330e12b-b8fd-432a-9a5a-845d0df98d89 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] VM Started (Lifecycle Event)
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 15 13:40:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:18 user nova-compute[72863]: INFO nova.compute.manager [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Took 7.45 seconds to build instance.
Aug 15 13:40:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-fa2a4899-3e42-4e73-b249-9be36bd196a5 tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.588s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:20 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106805.7511816, 37fbb78f-5384-4b98-bf2c-b54423083f56 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:40:20 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] VM Stopped (Lifecycle Event)
Aug 15 13:40:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-485dfbdb-449d-42ac-be11-b871e4b8410b None None] [instance: 37fbb78f-5384-4b98-bf2c-b54423083f56] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Starting finish_migration {{(pid=72863) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance directory exists: not creating {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 13:40:24 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Creating image(s)
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Ensure instance console log exists: /opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start _get_guest_xml network_info=[{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ef8e84a5-6dfd-4d63-9261-ad96770d1841', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c88999a3-03bb-4966-abf4-9357e936bd2e', 'attached_at': '2023-08-15T13:40:24.000000', 'detached_at': '', 'volume_id': '57a6558f-1e75-4d13-b8af-7214e69eff08', 'serial': '57a6558f-1e75-4d13-b8af-7214e69eff08'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:40:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'vcpu_model' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:40:24 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:40:24 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:40:24 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d58959-24cd-4574-91b0-7a98047f57ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:40:24 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092c602-2240-48ad-a8a5-d87ab7967c61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08] added
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa269e-1856-4187-8a24-d78cad87cbed]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e68926-50ba-4a12-af42-76cf48654f87]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhBMCtAE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhBMCtAE" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bda87c-dc55-4a3a-bb34-6ec6a10d5589]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhBMCtAE'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4949b21-bd91-4145-8eea-3db452c93f03]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b12a52f-2ccb-4640-a1ef-c8822dbc081f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[509656df-b9c8-494a-a48e-adaa30f4e7a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]
Aug 15 13:40:24 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf96f7-daea-44bd-b83b-3a730b391a6f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de053f9-745a-49af-ab1e-19fa028be64f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:40:24 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b66cc1-e30f-4eb2-a6f5-a6da95437042]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:40:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23638313438333133', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638313438333133', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:40:25 user nova-compute[72863]:   <uuid>c88999a3-03bb-4966-abf4-9357e936bd2e</uuid>
Aug 15 13:40:25 user nova-compute[72863]:   <name>instance-00000026</name>
Aug 15 13:40:25 user nova-compute[72863]:   <memory>2097152</memory>
Aug 15 13:40:25 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:40:25 user nova-compute[72863]:   <metadata>
Aug 15 13:40:25 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:40:25 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:40:25 user nova-compute[72863]:       <nova:name>tempest-ServerActionsTestOtherA-server-546999856</nova:name>
Aug 15 13:40:25 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:40:24</nova:creationTime>
Aug 15 13:40:25 user nova-compute[72863]:       <nova:flavor name="m1.small">
Aug 15 13:40:25 user nova-compute[72863]:         <nova:memory>2048</nova:memory>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:disk>20</nova:disk>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:40:25 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:40:25 user nova-compute[72863]:       <nova:owner>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:user uuid="d885a5f78b6e4c3c993fee958bee7cd0">tempest-ServerActionsTestOtherA-278685911-project-member</nova:user>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:project uuid="2d8a87964e7845cba898b18f2d5021ec">tempest-ServerActionsTestOtherA-278685911</nova:project>
Aug 15 13:40:25 user nova-compute[72863]:       </nova:owner>
Aug 15 13:40:25 user nova-compute[72863]:       <nova:ports>
Aug 15 13:40:25 user nova-compute[72863]:         <nova:port uuid="a339be36-1094-4a39-98fb-16669d43a54d">
Aug 15 13:40:25 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:40:25 user nova-compute[72863]:         </nova:port>
Aug 15 13:40:25 user nova-compute[72863]:       </nova:ports>
Aug 15 13:40:25 user nova-compute[72863]:     </nova:instance>
Aug 15 13:40:25 user nova-compute[72863]:   </metadata>
Aug 15 13:40:25 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:40:25 user nova-compute[72863]:     <system>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="serial">c88999a3-03bb-4966-abf4-9357e936bd2e</entry>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="uuid">c88999a3-03bb-4966-abf4-9357e936bd2e</entry>
Aug 15 13:40:25 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:40:25 user nova-compute[72863]:     </system>
Aug 15 13:40:25 user nova-compute[72863]:   </sysinfo>
Aug 15 13:40:25 user nova-compute[72863]:   <os>
Aug 15 13:40:25 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:40:25 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:40:25 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:40:25 user nova-compute[72863]:   </os>
Aug 15 13:40:25 user nova-compute[72863]:   <features>
Aug 15 13:40:25 user nova-compute[72863]:     <acpi/>
Aug 15 13:40:25 user nova-compute[72863]:     <apic/>
Aug 15 13:40:25 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:40:25 user nova-compute[72863]:   </features>
Aug 15 13:40:25 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:40:25 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:40:25 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:40:25 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:40:25 user nova-compute[72863]:   </clock>
Aug 15 13:40:25 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:40:25 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:40:25 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:40:25 user nova-compute[72863]:   </cpu>
Aug 15 13:40:25 user nova-compute[72863]:   <devices>
Aug 15 13:40:25 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:40:25 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:40:25 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:40:25 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:40:25 user nova-compute[72863]:       <serial>57a6558f-1e75-4d13-b8af-7214e69eff08</serial>
Aug 15 13:40:25 user nova-compute[72863]:     </disk>
Aug 15 13:40:25 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:40:25 user nova-compute[72863]:       <mac address="fa:16:3e:a8:a6:22"/>
Aug 15 13:40:25 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:40:25 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:40:25 user nova-compute[72863]:       <target dev="tapa339be36-10"/>
Aug 15 13:40:25 user nova-compute[72863]:     </interface>
Aug 15 13:40:25 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:40:25 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e/console.log" append="off"/>
Aug 15 13:40:25 user nova-compute[72863]:     </serial>
Aug 15 13:40:25 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:40:25 user nova-compute[72863]:     <video>
Aug 15 13:40:25 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:40:25 user nova-compute[72863]:     </video>
Aug 15 13:40:25 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:40:25 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:40:25 user nova-compute[72863]:     </rng>
Aug 15 13:40:25 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:40:25 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:40:25 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:40:25 user nova-compute[72863]:     </memballoon>
Aug 15 13:40:25 user nova-compute[72863]:   </devices>
Aug 15 13:40:25 user nova-compute[72863]: </domain>
Aug 15 13:40:25 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1746249178-network", "vif_mac": "fa:16:3e:a8:a6:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG os_vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa339be36-10, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa339be36-10, col_values=(('external_ids', {'iface-id': 'a339be36-1094-4a39-98fb-16669d43a54d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:a6:22', 'vm-uuid': 'c88999a3-03bb-4966-abf4-9357e936bd2e'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:25 user nova-compute[72863]: INFO os_vif [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10')
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] No VIF found with MAC fa:16:3e:a8:a6:22, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:29 user nova-compute[72863]: WARNING nova.compute.manager [req-81828d98-8943-4341-804c-196c175965e6 req-1d7adbd3-9c3e-4b80-8e83-d8b450959b76 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state active and task_state resize_finish.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:40:29 user nova-compute[72863]: WARNING nova.compute.manager [req-f396a529-3754-4f40-afe1-bf3a2042ed5d req-f2d8702d-aa31-43ea-aa00-c343460e3567 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state active and task_state resize_finish.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for c88999a3-03bb-4966-abf4-9357e936bd2e due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106829.1065779, c88999a3-03bb-4966-abf4-9357e936bd2e => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] VM Resumed (Lifecycle Event)
Aug 15 13:40:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7770MB free_disk=25.640037536621094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance running successfully.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Failed to set time: agent not configured {{(pid=72863) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-4023edbb-7b07-463d-93c7-7d6cf2546059 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] finish_migration finished successfully. {{(pid=72863) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106829.1073818, c88999a3-03bb-4966-abf4-9357e936bd2e => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] VM Started (Lifecycle Event)
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Applying migration context for instance c88999a3-03bb-4966-abf4-9357e936bd2e as it has an incoming, in-progress migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b. Migration status is post-migrating {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating resource usage from migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b
Aug 15 13:40:29 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 85dc30ef-6273-49a4-83e6-b265c44fa76a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d330e12b-b8fd-432a-9a5a-845d0df98d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:40:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:40:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:40:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:40:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:40:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:40:57 user nova-compute[72863]: INFO nova.compute.claims [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Claim successful on node user
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:40:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:40:57 user nova-compute[72863]: INFO nova.virt.block_device [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Booting with volume 44d69130-ff8d-4c4b-adad-c4b517a5b76c at /dev/vda
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.policy [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b852abe6-12d7-4562-8ca5-e461b0684aab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a2080-835f-458e-9ac1-5ba9fa5033c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282d0f0-052f-4d07-8d94-76e1a91b2d36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e3a5a-3599-4d0c-b398-683e4f01b453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:40:57 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:40:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448bd73-2cc5-4efa-b4b0-c67c3516a420]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG os_brick.utils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:40:57 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating existing volume attachment record: 41d939e4-e330-45ae-8553-67362d22987f {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:40:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Successfully created port: b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Successfully updated port: b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing instance network info cache due to event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] Acquiring lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:40:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Instance network_info: |[{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] Acquired lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updated VIF entry in instance network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-77e615ff-e160-4164-b4e0-f5eb4c6671e2 req-38155e92-ad9b-4896-9386-14e57f510307 service nova] Releasing lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:01 user nova-compute[72863]: INFO nova.compute.manager [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Unrescuing
Aug 15 13:41:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'flavor' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:02 user nova-compute[72863]: WARNING nova.compute.manager [req-c8025b03-017e-49cf-8aa8-7c388efdc2df req-6447e4a5-9486-416f-8b20-4b41db98dfe4 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:41:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance destroyed successfully.
Aug 15 13:41:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:04 user nova-compute[72863]: WARNING nova.compute.manager [req-22b66ad3-34b7-4bff-84cb-7fab5a96f9b1 req-e7a50546-a3c0-48b6-848a-29e6d5e08038 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:41:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:07 user nova-compute[72863]: WARNING nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:07 user nova-compute[72863]: WARNING nova.compute.manager [req-b3805124-1c16-46a0-b0d7-69dc2b1c4cb7 req-748c4e68-c1f2-4a94-a2dc-dc8d2ed8815e service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for e57ff0bd-4ddf-4e61-9908-52a7e51119df due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106867.326518, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:41:07 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Resumed (Lifecycle Event)
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0f0284b5-7006-4ec5-a0fb-8127709f001e tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:41:07 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106867.3285425, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:41:07 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Started (Lifecycle Event)
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:41:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Creating image(s)
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Ensure instance console log exists: /opt/stack/data/nova/instances/a3657ce0-ea19-4c4f-9102-3fabbbe72ed6/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Start _get_guest_xml network_info=[{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '41d939e4-e330-45ae-8553-67362d22987f', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3657ce0-ea19-4c4f-9102-3fabbbe72ed6', 'attached_at': '', 'detached_at': '', 'volume_id': '44d69130-ff8d-4c4b-adad-c4b517a5b76c', 'serial': '44d69130-ff8d-4c4b-adad-c4b517a5b76c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:41:08 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:41:08 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:41:08 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:41:08 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:41:08 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05fc0e5-6c7c-42a9-a819-03a7d1101f34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:41:08 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e2260-dfe1-457e-a121-0d6f73dbdcc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c] added
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1551f-e624-447c-88a6-46b24685370b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd1fb9-4e4e-48cb-8b89-0d8cae801184]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFowmKsJ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFowmKsJ" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d10dae-89d5-42de-94f8-49806e48f066]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFowmKsJ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d12689a-b798-4478-9e94-c5bab1e128a9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d8a1ec-7d9a-4376-a8ed-4f1521371f3e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94633c06-84e8-4f2b-99e6-81d6b55ee340]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]
Aug 15 13:41:08 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2537dc9e-a3ce-4580-842b-89b2aeeb8306]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68fbe53-a214-4f6c-a2ab-4cc572d2d17c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:41:08 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:41:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe1971-b1d0-47b4-a6fd-e3f8ecbe34ee]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:41:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23131623335636335', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623335636335', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-192197456',display_name='tempest-TestVolumeBootPattern-server-192197456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-192197456',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-jrmyu6lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:40:58Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=a3657ce0-ea19-4c4f-9102-3fabbbe72ed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:41:09 user nova-compute[72863]:   <uuid>a3657ce0-ea19-4c4f-9102-3fabbbe72ed6</uuid>
Aug 15 13:41:09 user nova-compute[72863]:   <name>instance-00000029</name>
Aug 15 13:41:09 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:41:09 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:41:09 user nova-compute[72863]:   <metadata>
Aug 15 13:41:09 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:41:09 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:41:09 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-server-192197456</nova:name>
Aug 15 13:41:09 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:41:08</nova:creationTime>
Aug 15 13:41:09 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:41:09 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:41:09 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:41:09 user nova-compute[72863]:       <nova:owner>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:41:09 user nova-compute[72863]:       </nova:owner>
Aug 15 13:41:09 user nova-compute[72863]:       <nova:ports>
Aug 15 13:41:09 user nova-compute[72863]:         <nova:port uuid="b29ebb52-5f5f-4418-ab49-b14444d2cf5f">
Aug 15 13:41:09 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 13:41:09 user nova-compute[72863]:         </nova:port>
Aug 15 13:41:09 user nova-compute[72863]:       </nova:ports>
Aug 15 13:41:09 user nova-compute[72863]:     </nova:instance>
Aug 15 13:41:09 user nova-compute[72863]:   </metadata>
Aug 15 13:41:09 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:41:09 user nova-compute[72863]:     <system>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="serial">a3657ce0-ea19-4c4f-9102-3fabbbe72ed6</entry>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="uuid">a3657ce0-ea19-4c4f-9102-3fabbbe72ed6</entry>
Aug 15 13:41:09 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:41:09 user nova-compute[72863]:     </system>
Aug 15 13:41:09 user nova-compute[72863]:   </sysinfo>
Aug 15 13:41:09 user nova-compute[72863]:   <os>
Aug 15 13:41:09 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:41:09 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:41:09 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:41:09 user nova-compute[72863]:   </os>
Aug 15 13:41:09 user nova-compute[72863]:   <features>
Aug 15 13:41:09 user nova-compute[72863]:     <acpi/>
Aug 15 13:41:09 user nova-compute[72863]:     <apic/>
Aug 15 13:41:09 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:41:09 user nova-compute[72863]:   </features>
Aug 15 13:41:09 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:41:09 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:41:09 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:41:09 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:41:09 user nova-compute[72863]:   </clock>
Aug 15 13:41:09 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:41:09 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:41:09 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:41:09 user nova-compute[72863]:   </cpu>
Aug 15 13:41:09 user nova-compute[72863]:   <devices>
Aug 15 13:41:09 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:41:09 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:41:09 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:41:09 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:41:09 user nova-compute[72863]:       <serial>44d69130-ff8d-4c4b-adad-c4b517a5b76c</serial>
Aug 15 13:41:09 user nova-compute[72863]:     </disk>
Aug 15 13:41:09 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:41:09 user nova-compute[72863]:       <mac address="fa:16:3e:ab:27:e7"/>
Aug 15 13:41:09 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:41:09 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:41:09 user nova-compute[72863]:       <target dev="tapb29ebb52-5f"/>
Aug 15 13:41:09 user nova-compute[72863]:     </interface>
Aug 15 13:41:09 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:41:09 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/a3657ce0-ea19-4c4f-9102-3fabbbe72ed6/console.log" append="off"/>
Aug 15 13:41:09 user nova-compute[72863]:     </serial>
Aug 15 13:41:09 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:41:09 user nova-compute[72863]:     <video>
Aug 15 13:41:09 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:41:09 user nova-compute[72863]:     </video>
Aug 15 13:41:09 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:41:09 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:41:09 user nova-compute[72863]:     </rng>
Aug 15 13:41:09 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:41:09 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:41:09 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:41:09 user nova-compute[72863]:     </memballoon>
Aug 15 13:41:09 user nova-compute[72863]:   </devices>
Aug 15 13:41:09 user nova-compute[72863]: </domain>
Aug 15 13:41:09 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-192197456',display_name='tempest-TestVolumeBootPattern-server-192197456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-192197456',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-jrmyu6lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:40:58Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=a3657ce0-ea19-4c4f-9102-3fabbbe72ed6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG os_vif [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb29ebb52-5f, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb29ebb52-5f, col_values=(('external_ids', {'iface-id': 'b29ebb52-5f5f-4418-ab49-b14444d2cf5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:27:e7', 'vm-uuid': 'a3657ce0-ea19-4c4f-9102-3fabbbe72ed6'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:09 user nova-compute[72863]: INFO os_vif [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f')
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:41:09 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:ab:27:e7, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing instance network info cache due to event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updated VIF entry in instance network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4eacffca-433f-47d0-ae85-9581f4057032 req-eee3abcf-a9f7-4063-a021-0a1e779c325b service nova] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:12 user nova-compute[72863]: WARNING nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state building and task_state spawning.
Aug 15 13:41:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:12 user nova-compute[72863]: WARNING nova.compute.manager [req-dbbb02c0-94d2-431d-9869-7b47775af920 req-d9ca86e9-0ea2-4edf-be59-1d8abeac6334 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state building and task_state spawning.
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106873.9424098, a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:41:13 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] VM Resumed (Lifecycle Event)
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:41:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Instance spawned successfully.
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:41:13 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:41:13 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106873.9433777, a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:41:13 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] VM Started (Lifecycle Event)
Aug 15 13:41:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:41:14 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:41:14 user nova-compute[72863]: INFO nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 15 13:41:14 user nova-compute[72863]: DEBUG nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:14 user nova-compute[72863]: INFO nova.compute.manager [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Took 17.15 seconds to build instance.
Aug 15 13:41:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-01f95f0d-3103-474c-aed9-e703e53fc5ac tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.430s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:16 user nova-compute[72863]: INFO nova.compute.manager [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Shelving
Aug 15 13:41:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:17 user nova-compute[72863]: WARNING nova.compute.manager [req-8f28d6af-8cca-4228-a3f8-58005f85bab1 req-455c9169-9809-4a90-bd08-0c055b73a55a service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving.
Aug 15 13:41:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance destroyed successfully.
Aug 15 13:41:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:17 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Beginning cold snapshot process
Aug 15 13:41:17 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:41:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk /opt/stack/data/nova/instances/snapshots/tmpmassldel/22aab675f6dd4af4bce40c3bf2a982ef {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk /opt/stack/data/nova/instances/snapshots/tmpmassldel/22aab675f6dd4af4bce40c3bf2a982ef" returned: 0 in 0.915s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Snapshot extracted, beginning image upload
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:19 user nova-compute[72863]: WARNING nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:19 user nova-compute[72863]: WARNING nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:19 user nova-compute[72863]: WARNING nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:19 user nova-compute[72863]: WARNING nova.compute.manager [req-c387b35e-c032-4de9-b92e-81a3da5a4275 req-58509529-954f-4148-b497-00488bd34e03 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:41:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:41:21 user nova-compute[72863]: WARNING nova.compute.manager [req-98e0a55d-e0f0-4063-a54b-2eafcbae1b82 req-f97fda2c-557a-4c94-a11a-aba0324c06fa service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:41:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Snapshot image upload complete
Aug 15 13:41:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:21 user nova-compute[72863]: INFO nova.compute.manager [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Shelve offloading
Aug 15 13:41:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance destroyed successfully.
Aug 15 13:41:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:41:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance destroyed successfully.
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'resources' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaEQf+iv7jk+vhXRxlt2Q0EclLPUbfCDR+F70dPACTSfRNTHdUhlgA5f0w58q5C749fYLq1XadjHSUVD33KbHoj5ukGwyT2pmVVR2PGHcdMSofoXH/9GcXCTagYLkLk5Q==',key_name='tempest-keypair-1575422208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:41:21.727952',shelved_host='user',shelved_image_id='d66bffb0-441a-4800-b85d-84bcb2d0858a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG os_vif [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4cd9a00-f7, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.compute.manager [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing instance network info cache due to event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.network.neutron [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:41:23 user nova-compute[72863]: INFO os_vif [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7')
Aug 15 13:41:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Deleting instance files /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a_del
Aug 15 13:41:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Deletion of /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a_del complete
Aug 15 13:41:23 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Deleted allocations for instance 85dc30ef-6273-49a4-83e6-b265c44fa76a
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'numa_topology' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8a468028-bde4-49c0-9377-13099a5a7c38 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.007s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updated VIF entry in instance network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e9c76076-8eb4-4437-b9af-a5da8dac3fde req-e1ed3ad3-536f-4a68-ab0a-0c184b928e7b service nova] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:41:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.504s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:41:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:41:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:41:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7530MB free_disk=25.568878173828125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Applying migration context for instance c88999a3-03bb-4966-abf4-9357e936bd2e as it has an incoming, in-progress migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b. Migration status is finished {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 13:41:27 user nova-compute[72863]: INFO nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating resource usage from migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance d330e12b-b8fd-432a-9a5a-845d0df98d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:41:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:41:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106877.5812933, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:41:32 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Stopped (Lifecycle Event)
Aug 15 13:41:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d155ea09-29c9-4f28-a331-6b8b41c33ac4 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:41:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [{"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-772fe730-8857-4520-9006-3972b660b933" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:41:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Going to confirm migration 2 {{(pid=72863) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:41:58 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'info_cache' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'migration_context' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:41:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.402s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:00 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Deleted allocation for migration a0ff4078-c2fc-4e4b-8e55-83b936a46b0b
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ffa64d5-61ba-43da-8e34-cefb3b3e5800 tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.477s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:42:00 user nova-compute[72863]: INFO nova.compute.claims [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Claim successful on node user
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:42:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:42:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG nova.policy [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ea18fce6a0b49e5b5aa04ac0f207495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f13fc66607d40eaa9e8a3249110a8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:42:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Creating image(s)
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "/opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "/opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "/opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.089s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.209s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:01 user nova-compute[72863]: INFO nova.compute.manager [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Terminating instance
Aug 15 13:42:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk 1073741824" returned: 0 in 0.061s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.216s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Cannot resize image /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.objects.instance [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'migration_context' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-unplugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] No waiting events found dispatching network-vif-unplugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-19b07c5e-9995-4a14-81fd-e5a0b50f7b9a req-01fe38f5-4856-41da-8631-65c00a9eb6f5 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-unplugged-1dc22923-7131-4387-b246-ad68db3e40b5 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Successfully created port: a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:42:02 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Instance destroyed successfully.
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.objects.instance [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'resources' on Instance uuid d330e12b-b8fd-432a-9a5a-845d0df98d89 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1694141962',display_name='tempest-VolumesActionsTest-instance-1694141962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1694141962',id=40,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-jtzvxt71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:40:18Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=d330e12b-b8fd-432a-9a5a-845d0df98d89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1dc22923-7131-4387-b246-ad68db3e40b5", "address": "fa:16:3e:5c:aa:9f", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc22923-71", "ovs_interfaceid": "1dc22923-7131-4387-b246-ad68db3e40b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG os_vif [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc22923-71, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:42:02 user nova-compute[72863]: INFO os_vif [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:aa:9f,bridge_name='br-int',has_traffic_filtering=True,id=1dc22923-7131-4387-b246-ad68db3e40b5,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc22923-71')
Aug 15 13:42:02 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Deleting instance files /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89_del
Aug 15 13:42:02 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Deletion of /opt/stack/data/nova/instances/d330e12b-b8fd-432a-9a5a-845d0df98d89_del complete
Aug 15 13:42:02 user nova-compute[72863]: INFO nova.compute.manager [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Took 0.80 seconds to destroy the instance on the hypervisor.
Aug 15 13:42:02 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:03 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Took 0.64 seconds to deallocate network for instance.
Aug 15 13:42:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-a179f681-43e5-4567-ae4a-569ccc6616d6 req-6a07b34d-4e1f-4f51-ab44-b06528bec791 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-deleted-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:42:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:03 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Deleted allocations for instance d330e12b-b8fd-432a-9a5a-845d0df98d89
Aug 15 13:42:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55e324d0-7a3d-4490-98cb-bcc3ebc11b3e tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Successfully updated port: a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquired lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Acquiring lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Lock "d330e12b-b8fd-432a-9a5a-845d0df98d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] No waiting events found dispatching network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:04 user nova-compute[72863]: WARNING nova.compute.manager [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Received unexpected event network-vif-plugged-1dc22923-7131-4387-b246-ad68db3e40b5 for instance with vm_state deleted and task_state None.
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing instance network info cache due to event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Acquiring lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Releasing lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Instance network_info: |[{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Acquired lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Start _get_guest_xml network_info=[{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:42:04 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:04 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-619756843',display_name='tempest-TestStampPattern-server-619756843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619756843',id=42,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-83fi8jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:42:01Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=9008be77-bd34-4015-94de-0c715cfc8e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.objects.instance [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'pci_devices' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:42:04 user nova-compute[72863]:   <uuid>9008be77-bd34-4015-94de-0c715cfc8e5d</uuid>
Aug 15 13:42:04 user nova-compute[72863]:   <name>instance-0000002a</name>
Aug 15 13:42:04 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:42:04 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:42:04 user nova-compute[72863]:   <metadata>
Aug 15 13:42:04 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:42:04 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:name>tempest-TestStampPattern-server-619756843</nova:name>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:42:04</nova:creationTime>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:42:04 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:42:04 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:owner>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:user uuid="2ea18fce6a0b49e5b5aa04ac0f207495">tempest-TestStampPattern-1256330650-project-member</nova:user>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:project uuid="1f13fc66607d40eaa9e8a3249110a8c6">tempest-TestStampPattern-1256330650</nova:project>
Aug 15 13:42:04 user nova-compute[72863]:       </nova:owner>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:42:04 user nova-compute[72863]:       <nova:ports>
Aug 15 13:42:04 user nova-compute[72863]:         <nova:port uuid="a4431105-80e4-4812-b7a7-0b8cf4d56fad">
Aug 15 13:42:04 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:42:04 user nova-compute[72863]:         </nova:port>
Aug 15 13:42:04 user nova-compute[72863]:       </nova:ports>
Aug 15 13:42:04 user nova-compute[72863]:     </nova:instance>
Aug 15 13:42:04 user nova-compute[72863]:   </metadata>
Aug 15 13:42:04 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:42:04 user nova-compute[72863]:     <system>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="serial">9008be77-bd34-4015-94de-0c715cfc8e5d</entry>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="uuid">9008be77-bd34-4015-94de-0c715cfc8e5d</entry>
Aug 15 13:42:04 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:42:04 user nova-compute[72863]:     </system>
Aug 15 13:42:04 user nova-compute[72863]:   </sysinfo>
Aug 15 13:42:04 user nova-compute[72863]:   <os>
Aug 15 13:42:04 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:42:04 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:42:04 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:42:04 user nova-compute[72863]:   </os>
Aug 15 13:42:04 user nova-compute[72863]:   <features>
Aug 15 13:42:04 user nova-compute[72863]:     <acpi/>
Aug 15 13:42:04 user nova-compute[72863]:     <apic/>
Aug 15 13:42:04 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:42:04 user nova-compute[72863]:   </features>
Aug 15 13:42:04 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:42:04 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:42:04 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:42:04 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:42:04 user nova-compute[72863]:   </clock>
Aug 15 13:42:04 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:42:04 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:42:04 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:42:04 user nova-compute[72863]:   </cpu>
Aug 15 13:42:04 user nova-compute[72863]:   <devices>
Aug 15 13:42:04 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:42:04 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:42:04 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk"/>
Aug 15 13:42:04 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:42:04 user nova-compute[72863]:     </disk>
Aug 15 13:42:04 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:42:04 user nova-compute[72863]:       <mac address="fa:16:3e:1e:c3:02"/>
Aug 15 13:42:04 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:42:04 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:42:04 user nova-compute[72863]:       <target dev="tapa4431105-80"/>
Aug 15 13:42:04 user nova-compute[72863]:     </interface>
Aug 15 13:42:04 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:42:04 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/console.log" append="off"/>
Aug 15 13:42:04 user nova-compute[72863]:     </serial>
Aug 15 13:42:04 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:42:04 user nova-compute[72863]:     <video>
Aug 15 13:42:04 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:42:04 user nova-compute[72863]:     </video>
Aug 15 13:42:04 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:42:04 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:42:04 user nova-compute[72863]:     </rng>
Aug 15 13:42:04 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:42:04 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:42:04 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:42:04 user nova-compute[72863]:     </memballoon>
Aug 15 13:42:04 user nova-compute[72863]:   </devices>
Aug 15 13:42:04 user nova-compute[72863]: </domain>
Aug 15 13:42:04 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-619756843',display_name='tempest-TestStampPattern-server-619756843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619756843',id=42,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-83fi8jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:42:01Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=9008be77-bd34-4015-94de-0c715cfc8e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG os_vif [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4431105-80, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4431105-80, col_values=(('external_ids', {'iface-id': 'a4431105-80e4-4812-b7a7-0b8cf4d56fad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:c3:02', 'vm-uuid': '9008be77-bd34-4015-94de-0c715cfc8e5d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:04 user nova-compute[72863]: INFO os_vif [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80')
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:42:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No VIF found with MAC fa:16:3e:1e:c3:02, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:42:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updated VIF entry in instance network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:42:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e54cdfdf-c5a0-442d-9301-59106eec6a21 req-21dbb489-d677-48d3-830a-3eb005f104d4 service nova] Releasing lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] No waiting events found dispatching network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:06 user nova-compute[72863]: WARNING nova.compute.manager [req-53d6f12c-bf25-4917-9915-b6283659efbd req-b5b2c468-f782-425a-ae35-8007d99707d2 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received unexpected event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad for instance with vm_state building and task_state spawning.
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106928.3732874, 9008be77-bd34-4015-94de-0c715cfc8e5d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] VM Resumed (Lifecycle Event)
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Instance spawned successfully.
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106928.3776312, 9008be77-bd34-4015-94de-0c715cfc8e5d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] VM Started (Lifecycle Event)
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] No waiting events found dispatching network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:08 user nova-compute[72863]: WARNING nova.compute.manager [req-0e59328a-72de-40e9-9eb6-e8e7a970dda8 req-91ab290d-d231-4309-8d0e-5d8c4e84c58f service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received unexpected event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad for instance with vm_state building and task_state spawning.
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Took 7.32 seconds to spawn the instance on the hypervisor.
Aug 15 13:42:08 user nova-compute[72863]: DEBUG nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:08 user nova-compute[72863]: INFO nova.compute.manager [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Took 8.25 seconds to build instance.
Aug 15 13:42:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-05ef99bf-eb35-4d79-9448-a0fc4fca3f62 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.355s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:17 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692106922.3817008, d330e12b-b8fd-432a-9a5a-845d0df98d89 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:42:17 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] VM Stopped (Lifecycle Event)
Aug 15 13:42:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3e6a5666-804b-4444-9f72-c9f0f1076e1e None None] [instance: d330e12b-b8fd-432a-9a5a-845d0df98d89] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:19 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:42:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:24 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:27 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=25.5645751953125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:42:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:32 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:42:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [{"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-eb797116-28dc-481b-af43-439920b4f269" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:42:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing instance network info cache due to event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:42:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] Acquiring lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] Acquired lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:48 user nova-compute[72863]: DEBUG nova.network.neutron [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:42:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updated VIF entry in instance network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:42:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4031b47f-0d30-4ada-95d3-4e15f4c4572f req-63c15092-9061-4247-ae19-2c4c679ae958 service nova] Releasing lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:42:53 user nova-compute[72863]: INFO nova.compute.claims [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Claim successful on node user
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing instance network info cache due to event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:42:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.policy [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5547a48d79ce450aa51c27e44bc50865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031bdc2cc8f46afbc58624292c7369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:42:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Creating image(s)
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "/opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "/opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:54 user nova-compute[72863]: INFO nova.compute.manager [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Detaching volume b71170b8-c651-498a-90c7-7891aec16ef5
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.network.neutron [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updated VIF entry in instance network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.network.neutron [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:54 user nova-compute[72863]: INFO nova.virt.block_device [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Attempting to driver detach volume b71170b8-c651-498a-90c7-7891aec16ef5 from mountpoint /dev/vdb
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-577e1433-2b7b-49ba-b99b-8ba6ca5386a7 req-e3fac0bc-458e-4cb9-9c3c-f73256773485 service nova] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Attempting to detach device vdb from instance e57ff0bd-4ddf-4e61-9908-52a7e51119df from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:42:54 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:42:54 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:42:54 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:42:54 user nova-compute[72863]:   <serial>b71170b8-c651-498a-90c7-7891aec16ef5</serial>
Aug 15 13:42:54 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:42:54 user nova-compute[72863]: </disk>
Aug 15 13:42:54 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:54 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully detached device vdb from instance e57ff0bd-4ddf-4e61-9908-52a7e51119df from the persistent domain config.
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e57ff0bd-4ddf-4e61-9908-52a7e51119df from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:42:54 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:42:54 user nova-compute[72863]:   <source dev="/dev/sdd"/>
Aug 15 13:42:54 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:42:54 user nova-compute[72863]:   <serial>b71170b8-c651-498a-90c7-7891aec16ef5</serial>
Aug 15 13:42:54 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:42:54 user nova-compute[72863]: </disk>
Aug 15 13:42:54 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk 1073741824" returned: 0 in 0.056s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Successfully created port: 1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692106974.996011, e57ff0bd-4ddf-4e61-9908-52a7e51119df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:42:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully detached device vdb from instance e57ff0bd-4ddf-4e61-9908-52a7e51119df from the live domain config.
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAqoMOlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:42:55 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c17a84-c68e-4d03-92c4-ecbe36114722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Cannot resize image /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'migration_context' on Instance uuid 1b829d12-43d2-439e-8744-bb91d9f75aa6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbee4c6-8f22-4125-9b60-014b38a2e2f8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:42:55 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:42:55 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:42:55 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 (non-flash)
Aug 15 13:42:55 user nova-compute[72863]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:42:55 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:42:55 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c2c0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Ensure instance console log exists: /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965a616-504f-46ec-a96f-f10f164ee7ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db4fb7-9ff5-4903-bc8c-97327cbcb583]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ada021-f754-44d0-91a5-1c9a7e6a9353]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ada6e3-5622-480a-8f49-10d9ed000f93]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76afc86-d80a-4741-964c-e24dc63c6268]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbccf86-b33a-481d-9050-276c4f460383]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260]
Aug 15 13:42:55 user nova-compute[72863]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5, portal: 172.16.0.220,3260] successful.
Aug 15 13:42:55 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71170b8-c651-498a-90c7-7891aec16ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c33a5-f0b3-451b-a29f-68cc61c897ef]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] <== disconnect_volume: return (355ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Successfully updated port: 1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquired lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-changed-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Refreshing instance network info cache due to event network-changed-1e321ea4-0d4f-4477-932e-fbf72c0d4807. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] Acquiring lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing instance network info cache due to event network-changed-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] Acquiring lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] Acquired lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Refreshing network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Updating instance_info_cache with network_info: [{"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Releasing lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Instance network_info: |[{"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] Acquired lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Refreshing network info cache for port 1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Start _get_guest_xml network_info=[{"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:42:56 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:56 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861556391',display_name='tempest-VolumesActionsTest-instance-1861556391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861556391',id=43,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-law1th04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:42:54Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=1b829d12-43d2-439e-8744-bb91d9f75aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b829d12-43d2-439e-8744-bb91d9f75aa6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:42:56 user nova-compute[72863]:   <uuid>1b829d12-43d2-439e-8744-bb91d9f75aa6</uuid>
Aug 15 13:42:56 user nova-compute[72863]:   <name>instance-0000002b</name>
Aug 15 13:42:56 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:42:56 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:42:56 user nova-compute[72863]:   <metadata>
Aug 15 13:42:56 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:42:56 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:name>tempest-VolumesActionsTest-instance-1861556391</nova:name>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:42:56</nova:creationTime>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:42:56 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:42:56 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:owner>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:user uuid="5547a48d79ce450aa51c27e44bc50865">tempest-VolumesActionsTest-1439550672-project-member</nova:user>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:project uuid="1031bdc2cc8f46afbc58624292c7369f">tempest-VolumesActionsTest-1439550672</nova:project>
Aug 15 13:42:56 user nova-compute[72863]:       </nova:owner>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:42:56 user nova-compute[72863]:       <nova:ports>
Aug 15 13:42:56 user nova-compute[72863]:         <nova:port uuid="1e321ea4-0d4f-4477-932e-fbf72c0d4807">
Aug 15 13:42:56 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 13:42:56 user nova-compute[72863]:         </nova:port>
Aug 15 13:42:56 user nova-compute[72863]:       </nova:ports>
Aug 15 13:42:56 user nova-compute[72863]:     </nova:instance>
Aug 15 13:42:56 user nova-compute[72863]:   </metadata>
Aug 15 13:42:56 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:42:56 user nova-compute[72863]:     <system>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="serial">1b829d12-43d2-439e-8744-bb91d9f75aa6</entry>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="uuid">1b829d12-43d2-439e-8744-bb91d9f75aa6</entry>
Aug 15 13:42:56 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:42:56 user nova-compute[72863]:     </system>
Aug 15 13:42:56 user nova-compute[72863]:   </sysinfo>
Aug 15 13:42:56 user nova-compute[72863]:   <os>
Aug 15 13:42:56 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:42:56 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:42:56 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:42:56 user nova-compute[72863]:   </os>
Aug 15 13:42:56 user nova-compute[72863]:   <features>
Aug 15 13:42:56 user nova-compute[72863]:     <acpi/>
Aug 15 13:42:56 user nova-compute[72863]:     <apic/>
Aug 15 13:42:56 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:42:56 user nova-compute[72863]:   </features>
Aug 15 13:42:56 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:42:56 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:42:56 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:42:56 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:42:56 user nova-compute[72863]:   </clock>
Aug 15 13:42:56 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:42:56 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:42:56 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:42:56 user nova-compute[72863]:   </cpu>
Aug 15 13:42:56 user nova-compute[72863]:   <devices>
Aug 15 13:42:56 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:42:56 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:42:56 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk"/>
Aug 15 13:42:56 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:42:56 user nova-compute[72863]:     </disk>
Aug 15 13:42:56 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:42:56 user nova-compute[72863]:       <mac address="fa:16:3e:bb:d6:15"/>
Aug 15 13:42:56 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:42:56 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:42:56 user nova-compute[72863]:       <target dev="tap1e321ea4-0d"/>
Aug 15 13:42:56 user nova-compute[72863]:     </interface>
Aug 15 13:42:56 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:42:56 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/console.log" append="off"/>
Aug 15 13:42:56 user nova-compute[72863]:     </serial>
Aug 15 13:42:56 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:42:56 user nova-compute[72863]:     <video>
Aug 15 13:42:56 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:42:56 user nova-compute[72863]:     </video>
Aug 15 13:42:56 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:42:56 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:42:56 user nova-compute[72863]:     </rng>
Aug 15 13:42:56 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:42:56 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:42:56 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:42:56 user nova-compute[72863]:     </memballoon>
Aug 15 13:42:56 user nova-compute[72863]:   </devices>
Aug 15 13:42:56 user nova-compute[72863]: </domain>
Aug 15 13:42:56 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861556391',display_name='tempest-VolumesActionsTest-instance-1861556391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861556391',id=43,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-law1th04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:42:54Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=1b829d12-43d2-439e-8744-bb91d9f75aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG os_vif [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e321ea4-0d, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e321ea4-0d, col_values=(('external_ids', {'iface-id': '1e321ea4-0d4f-4477-932e-fbf72c0d4807', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:d6:15', 'vm-uuid': '1b829d12-43d2-439e-8744-bb91d9f75aa6'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:56 user nova-compute[72863]: INFO os_vif [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d')
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'flavor' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] No VIF found with MAC fa:16:3e:bb:d6:15, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-ff784a00-57d0-44ca-9b52-a6bc884b22ce tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.920s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updated VIF entry in instance network info cache for port 4c8561a9-4df1-452d-9fcd-9c8d14f30bd4. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [{"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-487b3314-8544-430f-915f-c8f351aa91ce req-3f825b2b-00e4-496a-9ffa-4443ae5a85e5 service nova] Releasing lock "refresh_cache-e57ff0bd-4ddf-4e61-9908-52a7e51119df" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Updated VIF entry in instance network info cache for port 1e321ea4-0d4f-4477-932e-fbf72c0d4807. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Updating instance_info_cache with network_info: [{"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:42:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7bb88ead-3842-489f-aa61-0b1d23f413f4 req-4d8b6b5b-d091-4399-8721-ee1878bf2b49 service nova] Releasing lock "refresh_cache-1b829d12-43d2-439e-8744-bb91d9f75aa6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] No waiting events found dispatching network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:57 user nova-compute[72863]: WARNING nova.compute.manager [req-12808432-0800-4ae5-bc08-d8e9de0a8cef req-47287431-4fae-4f72-a9e7-8cb9ac68f55c service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received unexpected event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 for instance with vm_state building and task_state spawning.
Aug 15 13:42:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106979.7465315, 1b829d12-43d2-439e-8744-bb91d9f75aa6 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] VM Resumed (Lifecycle Event)
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Instance spawned successfully.
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106979.749554, 1b829d12-43d2-439e-8744-bb91d9f75aa6 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] VM Started (Lifecycle Event)
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] No waiting events found dispatching network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:42:59 user nova-compute[72863]: WARNING nova.compute.manager [req-8d7e2315-0a3f-4576-bede-1c9c0b92c60e req-37bc7761-27bb-4470-8836-0db0a6c5fac4 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received unexpected event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 for instance with vm_state building and task_state spawning.
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 15 13:42:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:42:59 user nova-compute[72863]: INFO nova.compute.manager [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Took 6.43 seconds to build instance.
Aug 15 13:43:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e5107df2-21db-4fdb-9f35-5ccd0914ef1a tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:02 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:43:02 user nova-compute[72863]: INFO nova.compute.claims [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Claim successful on node user
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:43:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:43:03 user nova-compute[72863]: INFO nova.virt.block_device [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Booting with volume 8aef769c-fada-44ff-add3-bef47ff30308 at /dev/vda
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.policy [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff7112dd18c04b1c9ca951ba52bcf868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc53f1a137d047dc9e07af4222644667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.utils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec1802-ef8c-41c3-8b6f-27c2173396b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2332c314-9f7d-4c8b-8815-e2980333a9a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe70ac4-fd72-4f0f-a232-9a53fc9f8f8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb48c3b-aa63-40a5-a94e-f0e92dfa7753]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:03 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:43:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6c09b-2950-43e3-9b64-fd05825946eb]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG os_brick.utils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:03 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating existing volume attachment record: ee760bf0-88f5-49d0-b79f-012ae7a260d3 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:43:04 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Successfully created port: bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:43:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Successfully updated port: bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquired lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing instance network info cache due to event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] Acquiring lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.network.neutron [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Releasing lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Instance network_info: |[{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] Acquired lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:43:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updated VIF entry in instance network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:43:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aceba975-28e5-4837-b4a4-80151f65175b req-862daffe-db8e-4f13-ad4f-73eb5a4b69b4 service nova] Releasing lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:08 user nova-compute[72863]: INFO nova.compute.manager [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Unshelving
Aug 15 13:43:09 user nova-compute[72863]: INFO nova.virt.block_device [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Booting with volume a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 at /dev/vdc
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.utils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f9d95-a30a-48cb-b231-d22d1118e602]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6e0753-6a2e-47de-bb58-b904481a1b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b77e1a-2f64-49a1-b5f3-8383f74c5453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a5db5-b78f-4858-8f53-1cce009b6ee6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:09 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:43:09 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d684c54-e26e-4511-bd98-56cfea0f1a6a]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG os_brick.utils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:09 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating existing volume attachment record: 0eacdca9-1e34-4471-a578-14acb16d4c48 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:43:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:43:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Creating image(s)
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Ensure instance console log exists: /opt/stack/data/nova/instances/807996dd-91e7-4cba-8f42-1d16be113184/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Start _get_guest_xml network_info=[{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ee760bf0-88f5-49d0-b79f-012ae7a260d3', 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRwjAsfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '807996dd-91e7-4cba-8f42-1d16be113184', 'attached_at': '', 'detached_at': '', 'volume_id': '8aef769c-fada-44ff-add3-bef47ff30308', 'serial': '8aef769c-fada-44ff-add3-bef47ff30308'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:43:13 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:13 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRwjAsfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:13 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:13 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:13 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:13 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:13 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:13 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:43:13 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2971842-43f0-47fb-99b1-6926ffc9065a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:43:14 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef3b71-924c-47d6-9c3a-95d45bdcbf43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308] added
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a93642-2781-4957-9c09-0159cacc856e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd2db6-b62c-41cf-8db0-4c08d974fc1d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRwjAsfl {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRwjAsfl" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[103869fc-c71e-4dcf-ae8b-9225a1838232]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cRwjAsfl'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ea247-1d05-49e1-8b22-df12d04a8cfd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a9641-d58a-41bd-aa24-d4955e6637d0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e03079-89ed-4d32-b27d-1f6dff5b5495]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260]
Aug 15 13:43:14 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260] successful.
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8eec02-d0dc-4ed5-b739-a7b58e51b311]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2d56c-69fc-4589-b889-95236b82f64c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:14 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7659e42-4327-4979-93cd-ac50b162bb28]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRwjAsfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23438613933396137', 'path': '/dev/sdd'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438613933396137', 'path': '/dev/sdd'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1945577658',display_name='tempest-TestVolumeBootPattern-server-1945577658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1945577658',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-uu5rq8o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:04Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=807996dd-91e7-4cba-8f42-1d16be113184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'pci_devices' on Instance uuid 807996dd-91e7-4cba-8f42-1d16be113184 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:43:15 user nova-compute[72863]:   <uuid>807996dd-91e7-4cba-8f42-1d16be113184</uuid>
Aug 15 13:43:15 user nova-compute[72863]:   <name>instance-0000002c</name>
Aug 15 13:43:15 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:43:15 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:43:15 user nova-compute[72863]:   <metadata>
Aug 15 13:43:15 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:43:15 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:43:15 user nova-compute[72863]:       <nova:name>tempest-TestVolumeBootPattern-server-1945577658</nova:name>
Aug 15 13:43:15 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:43:13</nova:creationTime>
Aug 15 13:43:15 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:43:15 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:43:15 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:43:15 user nova-compute[72863]:       <nova:owner>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:user uuid="ff7112dd18c04b1c9ca951ba52bcf868">tempest-TestVolumeBootPattern-1735501215-project-member</nova:user>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:project uuid="cc53f1a137d047dc9e07af4222644667">tempest-TestVolumeBootPattern-1735501215</nova:project>
Aug 15 13:43:15 user nova-compute[72863]:       </nova:owner>
Aug 15 13:43:15 user nova-compute[72863]:       <nova:ports>
Aug 15 13:43:15 user nova-compute[72863]:         <nova:port uuid="bf07bf31-0246-460e-8913-a55b51d72b0c">
Aug 15 13:43:15 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 13:43:15 user nova-compute[72863]:         </nova:port>
Aug 15 13:43:15 user nova-compute[72863]:       </nova:ports>
Aug 15 13:43:15 user nova-compute[72863]:     </nova:instance>
Aug 15 13:43:15 user nova-compute[72863]:   </metadata>
Aug 15 13:43:15 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:43:15 user nova-compute[72863]:     <system>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="serial">807996dd-91e7-4cba-8f42-1d16be113184</entry>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="uuid">807996dd-91e7-4cba-8f42-1d16be113184</entry>
Aug 15 13:43:15 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:43:15 user nova-compute[72863]:     </system>
Aug 15 13:43:15 user nova-compute[72863]:   </sysinfo>
Aug 15 13:43:15 user nova-compute[72863]:   <os>
Aug 15 13:43:15 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:43:15 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:43:15 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:43:15 user nova-compute[72863]:   </os>
Aug 15 13:43:15 user nova-compute[72863]:   <features>
Aug 15 13:43:15 user nova-compute[72863]:     <acpi/>
Aug 15 13:43:15 user nova-compute[72863]:     <apic/>
Aug 15 13:43:15 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:43:15 user nova-compute[72863]:   </features>
Aug 15 13:43:15 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:43:15 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:43:15 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:43:15 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:43:15 user nova-compute[72863]:   </clock>
Aug 15 13:43:15 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:43:15 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:43:15 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:43:15 user nova-compute[72863]:   </cpu>
Aug 15 13:43:15 user nova-compute[72863]:   <devices>
Aug 15 13:43:15 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:43:15 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:43:15 user nova-compute[72863]:       <source dev="/dev/sdd"/>
Aug 15 13:43:15 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:43:15 user nova-compute[72863]:       <serial>8aef769c-fada-44ff-add3-bef47ff30308</serial>
Aug 15 13:43:15 user nova-compute[72863]:     </disk>
Aug 15 13:43:15 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:43:15 user nova-compute[72863]:       <mac address="fa:16:3e:de:d1:c9"/>
Aug 15 13:43:15 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:15 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:43:15 user nova-compute[72863]:       <target dev="tapbf07bf31-02"/>
Aug 15 13:43:15 user nova-compute[72863]:     </interface>
Aug 15 13:43:15 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:43:15 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/807996dd-91e7-4cba-8f42-1d16be113184/console.log" append="off"/>
Aug 15 13:43:15 user nova-compute[72863]:     </serial>
Aug 15 13:43:15 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:43:15 user nova-compute[72863]:     <video>
Aug 15 13:43:15 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:15 user nova-compute[72863]:     </video>
Aug 15 13:43:15 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:43:15 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:43:15 user nova-compute[72863]:     </rng>
Aug 15 13:43:15 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:43:15 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:43:15 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:43:15 user nova-compute[72863]:     </memballoon>
Aug 15 13:43:15 user nova-compute[72863]:   </devices>
Aug 15 13:43:15 user nova-compute[72863]: </domain>
Aug 15 13:43:15 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1945577658',display_name='tempest-TestVolumeBootPattern-server-1945577658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1945577658',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-uu5rq8o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:04Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=807996dd-91e7-4cba-8f42-1d16be113184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG os_vif [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf07bf31-02, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf07bf31-02, col_values=(('external_ids', {'iface-id': 'bf07bf31-0246-460e-8913-a55b51d72b0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d1:c9', 'vm-uuid': '807996dd-91e7-4cba-8f42-1d16be113184'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:15 user nova-compute[72863]: INFO os_vif [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02')
Aug 15 13:43:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:43:15 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] No VIF found with MAC fa:16:3e:de:d1:c9, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:43:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] No waiting events found dispatching network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:18 user nova-compute[72863]: WARNING nova.compute.manager [req-449b74e9-5cb1-4d21-91ec-9968a7f2bba8 req-a4392f17-43ed-4c8b-92f6-3b86c306c06f service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received unexpected event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c for instance with vm_state building and task_state spawning.
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106998.8526402, 807996dd-91e7-4cba-8f42-1d16be113184 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] VM Resumed (Lifecycle Event)
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Instance spawned successfully.
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_requests' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692106998.8531747, 807996dd-91e7-4cba-8f42-1d16be113184 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] VM Started (Lifecycle Event)
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'numa_topology' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.claims [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Claim successful on node user
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:18 user nova-compute[72863]: INFO nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 15 13:43:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:19 user nova-compute[72863]: INFO nova.compute.manager [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Took 16.20 seconds to build instance.
Aug 15 13:43:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3ba2691f-8128-4daa-a8fc-8f81c3a1979f tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.288s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:19 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:43:19 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:43:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:19 user nova-compute[72863]: INFO nova.network.neutron [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating port b4cd9a00-f7d3-46bd-af23-d896e94a02ae with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] No waiting events found dispatching network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:20 user nova-compute[72863]: WARNING nova.compute.manager [req-6f47762b-e6a3-4644-ab26-7f844838db7b req-210da00e-3f9b-4728-a35d-397348cd9718 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received unexpected event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c for instance with vm_state active and task_state None.
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing instance network info cache due to event network-changed-b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] Acquiring lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.network.neutron [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:43:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Creating image(s)
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] Acquired lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Refreshing network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:21 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.part --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG nova.virt.images [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] d66bffb0-441a-4800-b85d-84bcb2d0858a was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.part /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updated VIF entry in instance network info cache for port b4cd9a00-f7d3-46bd-af23-d896e94a02ae. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-dff9a321-a508-4bf0-843c-b6029c300578 req-07ee9d3f-435e-465c-b685-2f3cd40b9f83 service nova] Releasing lock "refresh_cache-85dc30ef-6273-49a4-83e6-b265c44fa76a" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.part /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.converted" returned: 0 in 0.532s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.995s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json" returned: 0 in 0.198s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837,backing_fmt=raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837,backing_fmt=raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk 1073741824" returned: 0 in 0.048s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "8dc14eb62f55dcc5f5a7fa88e69853c972df0837" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'migration_context' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:23 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Rebasing disk image.
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 -F raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:43:25 user nova-compute[72863]: INFO nova.compute.claims [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Claim successful on node user
Aug 15 13:43:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 -F raw /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk" returned: 0 in 2.093s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Ensure instance console log exists: /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start _get_guest_xml network_info=[{"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='45b49450e0f5bba8a6dc900434ea0b00',container_format='bare',created_at=2023-08-15T13:41:17Z,direct_url=<?>,disk_format='qcow2',id=d66bffb0-441a-4800-b85d-84bcb2d0858a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1881959639-shelved',owner='2cc9a115e03e455bb340a4b23376c4c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T13:41:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0eacdca9-1e34-4471-a578-14acb16d4c48', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWhSiXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '85dc30ef-6273-49a4-83e6-b265c44fa76a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2', 'serial': 'a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:43:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:25 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='45b49450e0f5bba8a6dc900434ea0b00',container_format='bare',created_at=2023-08-15T13:41:17Z,direct_url=<?>,disk_format='qcow2',id=d66bffb0-441a-4800-b85d-84bcb2d0858a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1881959639-shelved',owner='2cc9a115e03e455bb340a4b23376c4c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T13:41:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWhSiXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:25 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:25 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:25 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71de84b1-392a-4952-b0cd-a13d83e1f707]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:43:25 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4389b80c-1377-4d2c-a5bf-5071206238c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2] added
Aug 15 13:43:25 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d91675-3f57-4ecc-ae20-5d874400960e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb3f56-020a-4ea8-b3f4-1f9c299914de]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWhSiXno {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:25 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWhSiXno" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a4276-ffd4-474b-a338-459f8850aa19]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UWhSiXno'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a292d1-894f-45c7-874f-85322d138c38]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[018df4de-8b98-4473-bc81-79794ee4dea3]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee301c4a-7aa4-4ac6-bc3f-b13fb57ddd04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260]
Aug 15 13:43:26 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260] successful.
Aug 15 13:43:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0863e-0b86-4348-9a54-4bb0c1851db0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac2b41-81cb-41f8-a26d-577c7ba706d8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:26 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9649008b-cc15-4bc3-b4e2-5b0e7b8dfd0b]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWhSiXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:43:26 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.policy [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ad4bb906fef4b7baa9d97acdc711574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0e885268a846f29fc247590d7c890e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:43:26 user nova-compute[72863]: INFO nova.virt.block_device [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Booting with volume ee8311de-bf99-4408-8d50-880ca640621a at /dev/vda
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c25b1-6da7-40e4-a028-649ae87ed8c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f233ff6-b725-4b27-9cad-5923c815bd36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e87d3-dc44-4db4-b6db-eee80517521b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731c159-8662-4030-84ac-a8084da15929]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:26 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619c61d-2c50-439b-8e0b-57213e76fca7]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG os_brick.utils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating existing volume attachment record: da8961ce-2795-49fd-b81e-415ea8172fb5 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '23536633463623266', 'path': '/dev/sde'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536633463623266', 'path': '/dev/sde'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Successfully created port: cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='d66bffb0-441a-4800-b85d-84bcb2d0858a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1575422208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:41:21.727952',shelved_host='user',shelved_image_id='d66bffb0-441a-4800-b85d-84bcb2d0858a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_devices' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:43:27 user nova-compute[72863]:   <uuid>85dc30ef-6273-49a4-83e6-b265c44fa76a</uuid>
Aug 15 13:43:27 user nova-compute[72863]:   <name>instance-00000027</name>
Aug 15 13:43:27 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:43:27 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:43:27 user nova-compute[72863]:   <metadata>
Aug 15 13:43:27 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:43:27 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1881959639</nova:name>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:43:25</nova:creationTime>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:43:27 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:43:27 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:owner>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:user uuid="68d851d4db5542b889871f7300ad5158">tempest-AttachVolumeShelveTestJSON-69904858-project-member</nova:user>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:project uuid="2cc9a115e03e455bb340a4b23376c4c5">tempest-AttachVolumeShelveTestJSON-69904858</nova:project>
Aug 15 13:43:27 user nova-compute[72863]:       </nova:owner>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:root type="image" uuid="d66bffb0-441a-4800-b85d-84bcb2d0858a"/>
Aug 15 13:43:27 user nova-compute[72863]:       <nova:ports>
Aug 15 13:43:27 user nova-compute[72863]:         <nova:port uuid="b4cd9a00-f7d3-46bd-af23-d896e94a02ae">
Aug 15 13:43:27 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:43:27 user nova-compute[72863]:         </nova:port>
Aug 15 13:43:27 user nova-compute[72863]:       </nova:ports>
Aug 15 13:43:27 user nova-compute[72863]:     </nova:instance>
Aug 15 13:43:27 user nova-compute[72863]:   </metadata>
Aug 15 13:43:27 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:43:27 user nova-compute[72863]:     <system>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="serial">85dc30ef-6273-49a4-83e6-b265c44fa76a</entry>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="uuid">85dc30ef-6273-49a4-83e6-b265c44fa76a</entry>
Aug 15 13:43:27 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:43:27 user nova-compute[72863]:     </system>
Aug 15 13:43:27 user nova-compute[72863]:   </sysinfo>
Aug 15 13:43:27 user nova-compute[72863]:   <os>
Aug 15 13:43:27 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:43:27 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:43:27 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:43:27 user nova-compute[72863]:   </os>
Aug 15 13:43:27 user nova-compute[72863]:   <features>
Aug 15 13:43:27 user nova-compute[72863]:     <acpi/>
Aug 15 13:43:27 user nova-compute[72863]:     <apic/>
Aug 15 13:43:27 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:43:27 user nova-compute[72863]:   </features>
Aug 15 13:43:27 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:43:27 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:43:27 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:43:27 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:43:27 user nova-compute[72863]:   </clock>
Aug 15 13:43:27 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:43:27 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:43:27 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:43:27 user nova-compute[72863]:   </cpu>
Aug 15 13:43:27 user nova-compute[72863]:   <devices>
Aug 15 13:43:27 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:43:27 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:43:27 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk"/>
Aug 15 13:43:27 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:43:27 user nova-compute[72863]:     </disk>
Aug 15 13:43:27 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:43:27 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:43:27 user nova-compute[72863]:       <source dev="/dev/sde"/>
Aug 15 13:43:27 user nova-compute[72863]:       <target dev="vdc" bus="virtio"/>
Aug 15 13:43:27 user nova-compute[72863]:       <serial>a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2</serial>
Aug 15 13:43:27 user nova-compute[72863]:     </disk>
Aug 15 13:43:27 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:43:27 user nova-compute[72863]:       <mac address="fa:16:3e:07:63:c0"/>
Aug 15 13:43:27 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:27 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:43:27 user nova-compute[72863]:       <target dev="tapb4cd9a00-f7"/>
Aug 15 13:43:27 user nova-compute[72863]:     </interface>
Aug 15 13:43:27 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:43:27 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/console.log" append="off"/>
Aug 15 13:43:27 user nova-compute[72863]:     </serial>
Aug 15 13:43:27 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:43:27 user nova-compute[72863]:     <video>
Aug 15 13:43:27 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:27 user nova-compute[72863]:     </video>
Aug 15 13:43:27 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:43:27 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:43:27 user nova-compute[72863]:     </rng>
Aug 15 13:43:27 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:43:27 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:43:27 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:43:27 user nova-compute[72863]:     </memballoon>
Aug 15 13:43:27 user nova-compute[72863]:   </devices>
Aug 15 13:43:27 user nova-compute[72863]: </domain>
Aug 15 13:43:27 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='d66bffb0-441a-4800-b85d-84bcb2d0858a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1575422208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:41:21.727952',shelved_host='user',shelved_image_id='d66bffb0-441a-4800-b85d-84bcb2d0858a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG os_vif [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4cd9a00-f7, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4cd9a00-f7, col_values=(('external_ids', {'iface-id': 'b4cd9a00-f7d3-46bd-af23-d896e94a02ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:63:c0', 'vm-uuid': '85dc30ef-6273-49a4-83e6-b265c44fa76a'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:27 user nova-compute[72863]: INFO os_vif [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7')
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No VIF found with MAC fa:16:3e:07:63:c0, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Successfully updated port: cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing instance network info cache due to event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.399951934814453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance e57ff0bd-4ddf-4e61-9908-52a7e51119df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1b829d12-43d2-439e-8744-bb91d9f75aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 807996dd-91e7-4cba-8f42-1d16be113184 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 48312188-1fe8-4d83-b619-21dc0e8e98be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.network.neutron [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance network_info: |[{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.network.neutron [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:43:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:30 user nova-compute[72863]: WARNING nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:30 user nova-compute[72863]: WARNING nova.compute.manager [req-d22cf68d-e992-4337-bd0b-cf0ac47ce884 req-19f40c9a-618f-4224-9d45-54b49c206ae8 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updated VIF entry in instance network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG nova.network.neutron [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-9a856e8f-f5c4-4145-bbc4-cdcdba684dde req-b2046e54-b8ce-43da-887e-32e5b135273e service nova] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107011.1147785, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:31 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Resumed (Lifecycle Event)
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:43:31 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance spawned successfully.
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:31 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107011.1160471, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:31 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Started (Lifecycle Event)
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:31 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:31 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5fb853dc-d566-417b-a048-1fa40f5dae61 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.562s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:43:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Creating image(s)
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Ensure instance console log exists: /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start _get_guest_xml network_info=[{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da8961ce-2795-49fd-b81e-415ea8172fb5', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48312188-1fe8-4d83-b619-21dc0e8e98be', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee8311de-bf99-4408-8d50-880ca640621a', 'serial': 'ee8311de-bf99-4408-8d50-880ca640621a'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:43:36 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:36 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:36 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:43:36 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca2ad56-fc0e-4846-97dd-90368f04d6fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:43:36 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaf3b3-598d-418e-b63d-046f820a7f2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a] added
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dab9a4-96d3-4d51-9f49-87ed5a2aa996]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e119304-7e05-455f-b0d1-b9ea8e4c8f00]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oILHdhkB {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oILHdhkB" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e89770-ac59-4f71-8fd2-3c8bfaf7756d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oILHdhkB'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[412eaaa8-0aed-46e8-9b24-82614b1a24d1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8bc282-4dac-41e4-8de3-f48920c2b59a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5636354-31de-48db-8f75-e7385a4516fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]
Aug 15 13:43:36 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e66244a-1048-421b-b348-61cb58223e54]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531c903-6e42-4898-b49d-5343e20a3626]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:43:36 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:43:36 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7cf46f-981a-41ca-af27-def791a82411]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:36 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26666333961306631', 'path': '/dev/sdf'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333961306631', 'path': '/dev/sdf'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUdOndPGjtkpy3AvPM2Qfj5GJ89Ka936KRsYI+Cp1/a+eX+x29hK//YCeCwEIGLeT5+9ifITnEksniwSBMuvLRSwT8rCdCMSxQkfVfUQnDrTT7VegCICLJA/n1bDFaXbA==',key_name='tempest-TestShelveInstance-838633721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:26Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'pci_devices' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:43:37 user nova-compute[72863]:   <uuid>48312188-1fe8-4d83-b619-21dc0e8e98be</uuid>
Aug 15 13:43:37 user nova-compute[72863]:   <name>instance-0000002d</name>
Aug 15 13:43:37 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:43:37 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:43:37 user nova-compute[72863]:   <metadata>
Aug 15 13:43:37 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:43:37 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:43:37 user nova-compute[72863]:       <nova:name>tempest-TestShelveInstance-server-1126009146</nova:name>
Aug 15 13:43:37 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:43:36</nova:creationTime>
Aug 15 13:43:37 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:43:37 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:43:37 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:43:37 user nova-compute[72863]:       <nova:owner>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:user uuid="9ad4bb906fef4b7baa9d97acdc711574">tempest-TestShelveInstance-144861718-project-member</nova:user>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:project uuid="3e0e885268a846f29fc247590d7c890e">tempest-TestShelveInstance-144861718</nova:project>
Aug 15 13:43:37 user nova-compute[72863]:       </nova:owner>
Aug 15 13:43:37 user nova-compute[72863]:       <nova:ports>
Aug 15 13:43:37 user nova-compute[72863]:         <nova:port uuid="cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d">
Aug 15 13:43:37 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:43:37 user nova-compute[72863]:         </nova:port>
Aug 15 13:43:37 user nova-compute[72863]:       </nova:ports>
Aug 15 13:43:37 user nova-compute[72863]:     </nova:instance>
Aug 15 13:43:37 user nova-compute[72863]:   </metadata>
Aug 15 13:43:37 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:43:37 user nova-compute[72863]:     <system>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="serial">48312188-1fe8-4d83-b619-21dc0e8e98be</entry>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="uuid">48312188-1fe8-4d83-b619-21dc0e8e98be</entry>
Aug 15 13:43:37 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:43:37 user nova-compute[72863]:     </system>
Aug 15 13:43:37 user nova-compute[72863]:   </sysinfo>
Aug 15 13:43:37 user nova-compute[72863]:   <os>
Aug 15 13:43:37 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:43:37 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:43:37 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:43:37 user nova-compute[72863]:   </os>
Aug 15 13:43:37 user nova-compute[72863]:   <features>
Aug 15 13:43:37 user nova-compute[72863]:     <acpi/>
Aug 15 13:43:37 user nova-compute[72863]:     <apic/>
Aug 15 13:43:37 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:43:37 user nova-compute[72863]:   </features>
Aug 15 13:43:37 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:43:37 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:43:37 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:43:37 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:43:37 user nova-compute[72863]:   </clock>
Aug 15 13:43:37 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:43:37 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:43:37 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:43:37 user nova-compute[72863]:   </cpu>
Aug 15 13:43:37 user nova-compute[72863]:   <devices>
Aug 15 13:43:37 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:43:37 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:43:37 user nova-compute[72863]:       <source dev="/dev/sdf"/>
Aug 15 13:43:37 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:43:37 user nova-compute[72863]:       <serial>ee8311de-bf99-4408-8d50-880ca640621a</serial>
Aug 15 13:43:37 user nova-compute[72863]:     </disk>
Aug 15 13:43:37 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:43:37 user nova-compute[72863]:       <mac address="fa:16:3e:fc:f4:db"/>
Aug 15 13:43:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:37 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:43:37 user nova-compute[72863]:       <target dev="tapcf26e8f0-5a"/>
Aug 15 13:43:37 user nova-compute[72863]:     </interface>
Aug 15 13:43:37 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:43:37 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be/console.log" append="off"/>
Aug 15 13:43:37 user nova-compute[72863]:     </serial>
Aug 15 13:43:37 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:43:37 user nova-compute[72863]:     <video>
Aug 15 13:43:37 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:43:37 user nova-compute[72863]:     </video>
Aug 15 13:43:37 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:43:37 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:43:37 user nova-compute[72863]:     </rng>
Aug 15 13:43:37 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:43:37 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:43:37 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:43:37 user nova-compute[72863]:     </memballoon>
Aug 15 13:43:37 user nova-compute[72863]:   </devices>
Aug 15 13:43:37 user nova-compute[72863]: </domain>
Aug 15 13:43:37 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUdOndPGjtkpy3AvPM2Qfj5GJ89Ka936KRsYI+Cp1/a+eX+x29hK//YCeCwEIGLeT5+9ifITnEksniwSBMuvLRSwT8rCdCMSxQkfVfUQnDrTT7VegCICLJA/n1bDFaXbA==',key_name='tempest-TestShelveInstance-838633721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:43:26Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG os_vif [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf26e8f0-5a, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf26e8f0-5a, col_values=(('external_ids', {'iface-id': 'cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f4:db', 'vm-uuid': '48312188-1fe8-4d83-b619-21dc0e8e98be'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:43:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:37 user nova-compute[72863]: INFO os_vif [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a')
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] No VIF found with MAC fa:16:3e:fc:f4:db, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [{"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-9fdc0841-80ef-48d8-83bc-db09fa20144e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG nova.compute.manager [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:39 user nova-compute[72863]: WARNING nova.compute.manager [req-950f38ee-b115-434f-bdab-857a0375f6d0 req-bd9f6543-229f-4e8e-a568-51d397b952d0 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state building and task_state spawning.
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:43:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107021.377291, 48312188-1fe8-4d83-b619-21dc0e8e98be => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Resumed (Lifecycle Event)
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance spawned successfully.
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107021.3791966, 48312188-1fe8-4d83-b619-21dc0e8e98be => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Started (Lifecycle Event)
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:41 user nova-compute[72863]: DEBUG nova.compute.manager [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:41 user nova-compute[72863]: WARNING nova.compute.manager [req-3614c13a-1e16-4b55-8dd8-2f62218f78d3 req-8bcd998d-1e2f-4624-a2de-15fe9b2bbd29 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state building and task_state spawning.
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:43:41 user nova-compute[72863]: INFO nova.compute.manager [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Took 16.27 seconds to build instance.
Aug 15 13:43:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-776de98e-bde3-4c26-b304-3b7f41f50c56 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.402s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:44 user nova-compute[72863]: INFO nova.compute.manager [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Terminating instance
Aug 15 13:43:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-0cfdbe7c-5151-4a0a-98a2-1255919bf446 req-53d9fff1-039e-4e32-b47b-ee631ea072b2 service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-unplugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Instance destroyed successfully.
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid e57ff0bd-4ddf-4e61-9908-52a7e51119df {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906475110',display_name='tempest-ServerRescueNegativeTestJSON-server-906475110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906475110',id=36,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3/CqsNPoLblksgHnuWpdXH+xAyL0IHv44zA5f9nnCLKIbUnXVKTiCDOiTq6SEg8ncJw8VJ72shN0w1YFN/X1YdGCJ6SW2mUjtQbI9DdjrN7z3/oxGBOoasMMfOGmSYiQ==',key_name='tempest-keypair-675175048',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:39:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-yjqop5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=e57ff0bd-4ddf-4e61-9908-52a7e51119df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "address": "fa:16:3e:d5:02:f7", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8561a9-4d", "ovs_interfaceid": "4c8561a9-4df1-452d-9fcd-9c8d14f30bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG os_vif [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c8561a9-4d, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:45 user nova-compute[72863]: INFO os_vif [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:02:f7,bridge_name='br-int',has_traffic_filtering=True,id=4c8561a9-4df1-452d-9fcd-9c8d14f30bd4,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8561a9-4d')
Aug 15 13:43:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Deleting instance files /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df_del
Aug 15 13:43:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Deletion of /opt/stack/data/nova/instances/e57ff0bd-4ddf-4e61-9908-52a7e51119df_del complete
Aug 15 13:43:45 user nova-compute[72863]: INFO nova.compute.manager [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 13:43:45 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:43:45 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:43:46 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:46 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Took 0.94 seconds to deallocate network for instance.
Aug 15 13:43:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:46 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:43:46 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:43:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:47 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Deleted allocations for instance e57ff0bd-4ddf-4e61-9908-52a7e51119df
Aug 15 13:43:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] Acquiring lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] No waiting events found dispatching network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:43:47 user nova-compute[72863]: WARNING nova.compute.manager [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received unexpected event network-vif-plugged-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 for instance with vm_state deleted and task_state None.
Aug 15 13:43:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e177c76c-8c17-47de-a6c0-e6548d18239a req-79b0a846-5e30-4f43-be75-62ee8b45b9ee service nova] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Received event network-vif-deleted-4c8561a9-4df1-452d-9fcd-9c8d14f30bd4 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c13c0df-02c1-473f-85f4-4182aca8cd7a tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "e57ff0bd-4ddf-4e61-9908-52a7e51119df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:50 user nova-compute[72863]: INFO nova.compute.manager [None req-9a56077b-050b-4cd3-8d19-a977bc61e51e tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Get console output
Aug 15 13:43:50 user nova-compute[72863]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 13:43:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:43:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing instance network info cache due to event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:43:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] Acquiring lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:43:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] Acquired lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:43:52 user nova-compute[72863]: DEBUG nova.network.neutron [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG nova.objects.instance [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updated VIF entry in instance network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a174f5ec-0a7b-46c2-94b1-c0c4aae4d55b req-c1b5dfef-bf96-4f1b-a3b3-2fc704105ee5 service nova] Releasing lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:43:53 user nova-compute[72863]: INFO nova.compute.manager [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Attaching volume ce413e24-b454-48a4-949a-ae457b0d1fc8 to /dev/vdb
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.utils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e96146-095b-430f-9971-1a9d2add2c4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf873cb-80db-45a4-8ffc-b9c42e7b6624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[626dc383-ce24-4677-ad96-41727ed4f318]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10ef68-8e66-4d64-8770-0ad3ebb71a7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:43:53 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:43:53 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f577c0a-d411-4154-b62d-cad3cf3ff23d]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG os_brick.utils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:43:53 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating existing volume attachment record: fbc669f2-f4d4-4c31-ac04-41d0d3c174ef {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:43:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:43:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:00 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107025.4804728, e57ff0bd-4ddf-4e61-9908-52a7e51119df => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:44:00 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] VM Stopped (Lifecycle Event)
Aug 15 13:44:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-00829b8a-7219-4084-ba5a-4b67081fe77e None None] [instance: e57ff0bd-4ddf-4e61-9908-52a7e51119df] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:44:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvOEAzxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:44:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:44:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:44:03 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa490d-39da-4d55-8db1-9f1641c8e3f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:44:03 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18633c-a8e2-4978-ae0f-02e9110e9c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8] added
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a9255d-94b3-4072-8892-c026f297d223]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d1086-09fd-4ad6-ab6a-13c2afa53383]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvOEAzxj {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvOEAzxj" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e5267-2f82-4dc0-a5ff-1266dbba7ae8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvOEAzxj'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf31cdd-3be3-44e2-8345-12d4380ba58f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[27704556-effb-455c-bdf4-2a1b4a0e5692]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28059ab8-55c7-4ee6-94ab-a4f661290dfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260]
Aug 15 13:44:03 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260] successful.
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc0d2b7-7907-4953-a526-3059dfb2416d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3117a85a-7736-4f4b-94d7-1f980d279e5d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:03 user nova-compute[72863]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)
Aug 15 13:44:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] HCTL ('38', '-', '-', 0) found on session 48 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03578a-2cc0-4dd0-8725-d601ba893e27]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching for a device in session 48 and hctl ['38', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching for a device in session 48 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvOEAzxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23432346336323639', 'path': '/dev/sdg'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432346336323639', 'path': '/dev/sdg'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.objects.instance [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:44:04 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:44:04 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:44:04 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:44:04 user nova-compute[72863]:   <serial>ce413e24-b454-48a4-949a-ae457b0d1fc8</serial>
Aug 15 13:44:04 user nova-compute[72863]: </disk>
Aug 15 13:44:04 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:44:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No VIF found with MAC fa:16:3e:1e:c3:02, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:44:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-003fb97d-b4f7-4e45-8fe7-8da2b84f2215 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.788s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:07 user nova-compute[72863]: INFO nova.compute.manager [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Detaching volume ce413e24-b454-48a4-949a-ae457b0d1fc8
Aug 15 13:44:07 user nova-compute[72863]: INFO nova.virt.block_device [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Attempting to driver detach volume ce413e24-b454-48a4-949a-ae457b0d1fc8 from mountpoint /dev/vdb
Aug 15 13:44:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Attempting to detach device vdb from instance 9008be77-bd34-4015-94de-0c715cfc8e5d from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:44:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:44:07 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:44:07 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:44:07 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:44:07 user nova-compute[72863]:   <serial>ce413e24-b454-48a4-949a-ae457b0d1fc8</serial>
Aug 15 13:44:07 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:44:07 user nova-compute[72863]: </disk>
Aug 15 13:44:07 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:44:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully detached device vdb from instance 9008be77-bd34-4015-94de-0c715cfc8e5d from the persistent domain config.
Aug 15 13:44:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9008be77-bd34-4015-94de-0c715cfc8e5d from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:44:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:44:07 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:44:07 user nova-compute[72863]:   <source dev="/dev/sdg"/>
Aug 15 13:44:07 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:44:07 user nova-compute[72863]:   <serial>ce413e24-b454-48a4-949a-ae457b0d1fc8</serial>
Aug 15 13:44:07 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:44:07 user nova-compute[72863]: </disk>
Aug 15 13:44:07 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107048.1128201, 9008be77-bd34-4015-94de-0c715cfc8e5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:44:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully detached device vdb from instance 9008be77-bd34-4015-94de-0c715cfc8e5d from the live domain config.
Aug 15 13:44:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvOEAzxj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:44:08 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a2e2d0-79e9-44c9-85ac-a6444959ec0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd3cf2f-cad0-4b26-9dfc-927a7f27ef4b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:08 user nova-compute[72863]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 (non-flash)
Aug 15 13:44:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4e08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8'): ({'sdg'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Removing single pathed devices sdg {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[debdc18c-218b-40a3-b84e-d74639b040d9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f939c6f-f9c6-4da2-8c81-d13b057ee93b]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flushing IO for device /dev/sdg {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf874a-d8c0-4454-b294-379ebe66ac4f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29280f22-aa4e-4e1a-b2de-ad3a7bee7bf5]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] SCSI volumes sdg have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[046d1ca2-f94c-4920-9f18-f77b93b56d3a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c90b7a-27d2-4ff9-a5d7-ea2a896c9d83]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260]
Aug 15 13:44:08 user nova-compute[72863]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8, portal: 172.16.0.220,3260] successful.
Aug 15 13:44:08 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce413e24-b454-48a4-949a-ae457b0d1fc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e465cff-5368-495c-a122-a10d690800e6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== disconnect_volume: return (325ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:44:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:44:09 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5f35ca3b-e7af-45ee-90c5-f6a8448c1a8b tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.676s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:44:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:44:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:44:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7262MB free_disk=25.521751403808594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9fdc0841-80ef-48d8-83bc-db09fa20144e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance c88999a3-03bb-4966-abf4-9357e936bd2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 1b829d12-43d2-439e-8744-bb91d9f75aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 807996dd-91e7-4cba-8f42-1d16be113184 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 85dc30ef-6273-49a4-83e6-b265c44fa76a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 48312188-1fe8-4d83-b619-21dc0e8e98be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:44:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:44:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:44:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:44:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:44:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [{"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-c88999a3-03bb-4966-abf4-9357e936bd2e" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:44:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:44:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:44 user nova-compute[72863]: INFO nova.compute.manager [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Terminating instance
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-unplugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] No waiting events found dispatching network-vif-unplugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.compute.manager [req-275c4a7c-2c4c-49d5-9aa5-3a7320163a7a req-eea9c907-627a-4e68-88de-ddbb255e7682 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-unplugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:44:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Instance destroyed successfully.
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lazy-loading 'resources' on Instance uuid 1b829d12-43d2-439e-8744-bb91d9f75aa6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861556391',display_name='tempest-VolumesActionsTest-instance-1861556391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861556391',id=43,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:42:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1031bdc2cc8f46afbc58624292c7369f',ramdisk_id='',reservation_id='r-law1th04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1439550672',owner_user_name='tempest-VolumesActionsTest-1439550672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:43:00Z,user_data=None,user_id='5547a48d79ce450aa51c27e44bc50865',uuid=1b829d12-43d2-439e-8744-bb91d9f75aa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converting VIF {"id": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "address": "fa:16:3e:bb:d6:15", "network": {"id": "3dd7835f-d33e-45cf-896a-5557574ff0c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1018341253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1031bdc2cc8f46afbc58624292c7369f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e321ea4-0d", "ovs_interfaceid": "1e321ea4-0d4f-4477-932e-fbf72c0d4807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG os_vif [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e321ea4-0d, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:44 user nova-compute[72863]: INFO os_vif [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=1e321ea4-0d4f-4477-932e-fbf72c0d4807,network=Network(3dd7835f-d33e-45cf-896a-5557574ff0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e321ea4-0d')
Aug 15 13:44:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Deleting instance files /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6_del
Aug 15 13:44:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Deletion of /opt/stack/data/nova/instances/1b829d12-43d2-439e-8744-bb91d9f75aa6_del complete
Aug 15 13:44:44 user nova-compute[72863]: INFO nova.compute.manager [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 13:44:44 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:44:44 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:45 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Took 0.52 seconds to deallocate network for instance.
Aug 15 13:44:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-5ff043cd-7fc7-4421-ab14-c2b685304549 req-ce2cce3d-5cd9-45a9-a9dd-34e6c97ec410 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-deleted-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:44:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:45 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Deleted allocations for instance 1b829d12-43d2-439e-8744-bb91d9f75aa6
Aug 15 13:44:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c7514432-5da6-4c0b-ab5e-ca18433bcfab tempest-VolumesActionsTest-1439550672 tempest-VolumesActionsTest-1439550672-project-member] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.709s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] Acquiring lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] Lock "1b829d12-43d2-439e-8744-bb91d9f75aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] No waiting events found dispatching network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:46 user nova-compute[72863]: WARNING nova.compute.manager [req-65b651b9-e6c4-4d50-b86c-34cec44e194b req-02e9bbc3-2a7d-40dd-91f1-648524ccc798 service nova] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Received unexpected event network-vif-plugged-1e321ea4-0d4f-4477-932e-fbf72c0d4807 for instance with vm_state deleted and task_state None.
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:49 user nova-compute[72863]: INFO nova.compute.manager [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Terminating instance
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-1c07313a-0206-4e9b-8f84-35d5dd694762 req-4d2cf74c-4b62-454b-8aa1-e1ad130119e5 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-unplugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:44:49 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Instance destroyed successfully.
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid 9fdc0841-80ef-48d8-83bc-db09fa20144e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1773750799',display_name='tempest-ServerRescueNegativeTestJSON-server-1773750799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1773750799',id=20,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-uwt2f1bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:30:26Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=9fdc0841-80ef-48d8-83bc-db09fa20144e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "06aadf08-917e-498a-80a8-2428643011e1", "address": "fa:16:3e:bb:5c:75", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aadf08-91", "ovs_interfaceid": "06aadf08-917e-498a-80a8-2428643011e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG os_vif [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06aadf08-91, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:50 user nova-compute[72863]: INFO os_vif [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=06aadf08-917e-498a-80a8-2428643011e1,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aadf08-91')
Aug 15 13:44:50 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Deleting instance files /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e_del
Aug 15 13:44:50 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Deletion of /opt/stack/data/nova/instances/9fdc0841-80ef-48d8-83bc-db09fa20144e_del complete
Aug 15 13:44:50 user nova-compute[72863]: INFO nova.compute.manager [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:50 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Took 0.55 seconds to deallocate network for instance.
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-1f605365-c429-4312-8758-4af77b0db718 req-3d6880fe-d0f9-4712-9a23-eb6ba2a48375 service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-deleted-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:50 user nova-compute[72863]: INFO nova.compute.manager [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Terminating instance
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:44:50 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:51 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Deleted allocations for instance 9fdc0841-80ef-48d8-83bc-db09fa20144e
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-84839503-4556-4521-a280-3e5794e8107d tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Instance destroyed successfully.
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'resources' on Instance uuid c88999a3-03bb-4966-abf4-9357e936bd2e {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-546999856',display_name='tempest-ServerActionsTestOtherA-server-546999856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-546999856',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-ypv85y3b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=c88999a3-03bb-4966-abf4-9357e936bd2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "a339be36-1094-4a39-98fb-16669d43a54d", "address": "fa:16:3e:a8:a6:22", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa339be36-10", "ovs_interfaceid": "a339be36-1094-4a39-98fb-16669d43a54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_vif [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa339be36-10, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:51 user nova-compute[72863]: INFO os_vif [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a6:22,bridge_name='br-int',has_traffic_filtering=True,id=a339be36-1094-4a39-98fb-16669d43a54d,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa339be36-10')
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhBMCtAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:44:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ff1846-5516-441e-ab09-48b990c86134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08391d1e-b38d-438d-966f-fc73f920677e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:51 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c210d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe0579-e4dd-4150-b51e-daabb952220b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72408b71-5c61-4de8-a256-8057b3502fd3]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da902ad0-883d-4cd1-bf86-c5c8fca7e7e0]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba7dd7-7eb8-40e4-8b67-71ab9b5a0292]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ac3a259', '/dev/disk/by-id/scsi-23638313438333133', '/dev/disk/by-id/scsi-1SCST_BIO3ac3a259-68148313d3d1e1c3') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e8fec-466b-49fe-948b-07a3b4930b1f]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3fd72-127b-4bcd-b1ad-6e90f150afc9]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Acquiring lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "9fdc0841-80ef-48d8-83bc-db09fa20144e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] No waiting events found dispatching network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:51 user nova-compute[72863]: WARNING nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Received unexpected event network-vif-plugged-06aadf08-917e-498a-80a8-2428643011e1 for instance with vm_state deleted and task_state None.
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-unplugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Acquiring lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] No waiting events found dispatching network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:51 user nova-compute[72863]: WARNING nova.compute.manager [req-89e747d8-6f25-41dd-8466-f8f5eb11a48c req-657ff934-8561-4b9c-852a-eaf285c9814f service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received unexpected event network-vif-plugged-a339be36-1094-4a39-98fb-16669d43a54d for instance with vm_state active and task_state deleting.
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444a95d-0046-4e7d-b63d-ede4d9da670d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260]
Aug 15 13:44:51 user nova-compute[72863]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08, portal: 172.16.0.220,3260] successful.
Aug 15 13:44:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57a6558f-1e75-4d13-b8af-7214e69eff08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52a8a1-6b03-42d0-9831-23c090b4c629]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] <== disconnect_volume: return (327ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:44:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Deleting instance files /opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e_del
Aug 15 13:44:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Deletion of /opt/stack/data/nova/instances/c88999a3-03bb-4966-abf4-9357e936bd2e_del complete
Aug 15 13:44:51 user nova-compute[72863]: INFO nova.compute.manager [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 13:44:51 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:44:51 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:44:53 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:53 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Took 1.24 seconds to deallocate network for instance.
Aug 15 13:44:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-a44e9d3c-d14d-4228-83a1-3a79be83cb38 req-6b003162-c558-4c56-9791-b8da11c889d7 service nova] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Received event network-vif-deleted-a339be36-1094-4a39-98fb-16669d43a54d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:53 user nova-compute[72863]: INFO nova.compute.manager [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 13:44:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Deleting volume: 57a6558f-1e75-4d13-b8af-7214e69eff08 {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:44:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:54 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:44:54 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:44:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:54 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Deleted allocations for instance c88999a3-03bb-4966-abf4-9357e936bd2e
Aug 15 13:44:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c65cb30d-1d86-4086-acfe-a9d2a2f711ea tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "c88999a3-03bb-4966-abf4-9357e936bd2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.722s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing instance network info cache due to event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] Acquiring lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] Acquired lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updated VIF entry in instance network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b735b9e-31ad-44e0-9100-3a866b1d5c68 req-2dcdc51c-4cf3-4fba-b3d5-f04f416215c7 service nova] Releasing lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing instance network info cache due to event network-changed-bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] Acquiring lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] Acquired lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Refreshing network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:56 user nova-compute[72863]: INFO nova.compute.manager [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Terminating instance
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updated VIF entry in instance network info cache for port bf07bf31-0246-460e-8913-a55b51d72b0c. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [{"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-01f01e3b-9031-4580-9f8a-8c74d17ca085 req-a64c83f0-c5b0-4ac9-9af8-c31ecd082418 service nova] Releasing lock "refresh_cache-807996dd-91e7-4cba-8f42-1d16be113184" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:44:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Instance destroyed successfully.
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid 807996dd-91e7-4cba-8f42-1d16be113184 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1945577658',display_name='tempest-TestVolumeBootPattern-server-1945577658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1945577658',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-uu5rq8o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:43:19Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=807996dd-91e7-4cba-8f42-1d16be113184,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "bf07bf31-0246-460e-8913-a55b51d72b0c", "address": "fa:16:3e:de:d1:c9", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf07bf31-02", "ovs_interfaceid": "bf07bf31-0246-460e-8913-a55b51d72b0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_vif [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf07bf31-02, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:44:57 user nova-compute[72863]: INFO os_vif [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:c9,bridge_name='br-int',has_traffic_filtering=True,id=bf07bf31-0246-460e-8913-a55b51d72b0c,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf07bf31-02')
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRwjAsfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:44:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25809e-47b8-43d3-9342-e1f6a034e87f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2b171-5a36-4ddb-a0d6-cf185c59c98a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:44:57 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:44:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c271990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308'): ({'sdd'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sdd {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe36ca45-6fd5-4948-b577-215979baf092]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad284b61-3206-4639-b9df-236df087941c]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sdd {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2801f578-e216-4d5f-9252-687f5b31901b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca372c-e9f8-450c-965b-2d3d86188fa5]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sdd have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b91db5-855e-4b55-a257-8c8d6d92e32a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[570eb6c0-5072-4003-b9b3-005f8b419f94]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260]
Aug 15 13:44:57 user nova-compute[72863]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308, portal: 172.16.0.220,3260] successful.
Aug 15 13:44:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aef769c-fada-44ff-add3-bef47ff30308 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6ad0d-b26a-497e-b434-3d8403a84864]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (315ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:44:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Deleting instance files /opt/stack/data/nova/instances/807996dd-91e7-4cba-8f42-1d16be113184_del
Aug 15 13:44:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Deletion of /opt/stack/data/nova/instances/807996dd-91e7-4cba-8f42-1d16be113184_del complete
Aug 15 13:44:57 user nova-compute[72863]: INFO nova.compute.manager [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 13:44:57 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:44:57 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:58 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Took 0.62 seconds to deallocate network for instance.
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ef3f9ac-ea8a-469d-9757-c7fceadf7794 req-15501b07-303a-41d1-8c66-90168f5ac162 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-deleted-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:58 user nova-compute[72863]: INFO nova.compute.manager [req-7ef3f9ac-ea8a-469d-9757-c7fceadf7794 req-15501b07-303a-41d1-8c66-90168f5ac162 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Neutron deleted interface bf07bf31-0246-460e-8913-a55b51d72b0c; detaching it from the instance and deleting it from the info cache
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.network.neutron [req-7ef3f9ac-ea8a-469d-9757-c7fceadf7794 req-15501b07-303a-41d1-8c66-90168f5ac162 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ef3f9ac-ea8a-469d-9757-c7fceadf7794 req-15501b07-303a-41d1-8c66-90168f5ac162 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Detach interface failed, port_id=bf07bf31-0246-460e-8913-a55b51d72b0c, reason: Instance 807996dd-91e7-4cba-8f42-1d16be113184 could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-unplugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] No waiting events found dispatching network-vif-unplugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-unplugged-bf07bf31-0246-460e-8913-a55b51d72b0c for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Acquiring lock "807996dd-91e7-4cba-8f42-1d16be113184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] Lock "807996dd-91e7-4cba-8f42-1d16be113184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:58 user nova-compute[72863]: DEBUG nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] No waiting events found dispatching network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:44:58 user nova-compute[72863]: WARNING nova.compute.manager [req-71b27571-a898-4fa0-8de1-a93e3a3fd09e req-19b4d785-5a0e-4cde-aa37-95230bbbb6f2 service nova] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Received unexpected event network-vif-plugged-bf07bf31-0246-460e-8913-a55b51d72b0c for instance with vm_state active and task_state deleting.
Aug 15 13:44:58 user nova-compute[72863]: INFO nova.compute.manager [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:59 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance 807996dd-91e7-4cba-8f42-1d16be113184
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-9e2d8bee-02ac-402a-8476-8a4309f096ba tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "807996dd-91e7-4cba-8f42-1d16be113184" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.060s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:44:59 user nova-compute[72863]: INFO nova.compute.manager [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Detaching volume a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2
Aug 15 13:44:59 user nova-compute[72863]: INFO nova.virt.block_device [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Attempting to driver detach volume a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 from mountpoint /dev/vdc
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107084.657862, 1b829d12-43d2-439e-8744-bb91d9f75aa6 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:44:59 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] VM Stopped (Lifecycle Event)
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Attempting to detach device vdc from instance 85dc30ef-6273-49a4-83e6-b265c44fa76a from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:44:59 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:44:59 user nova-compute[72863]:   <source dev="/dev/sde"/>
Aug 15 13:44:59 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:44:59 user nova-compute[72863]:   <serial>a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2</serial>
Aug 15 13:44:59 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:44:59 user nova-compute[72863]: </disk>
Aug 15 13:44:59 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:44:59 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully detached device vdc from instance 85dc30ef-6273-49a4-83e6-b265c44fa76a from the persistent domain config.
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 85dc30ef-6273-49a4-83e6-b265c44fa76a from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:44:59 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:44:59 user nova-compute[72863]:   <source dev="/dev/sde"/>
Aug 15 13:44:59 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:44:59 user nova-compute[72863]:   <serial>a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2</serial>
Aug 15 13:44:59 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:44:59 user nova-compute[72863]: </disk>
Aug 15 13:44:59 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:44:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e9388e8a-fd61-4ebd-9bf6-7dda247abf9e None None] [instance: 1b829d12-43d2-439e-8744-bb91d9f75aa6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107100.1425703, 85dc30ef-6273-49a4-83e6-b265c44fa76a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:45:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully detached device vdc from instance 85dc30ef-6273-49a4-83e6-b265c44fa76a from the live domain config.
Aug 15 13:45:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWhSiXno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:45:00 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e548a38-0bfd-42ee-807c-5b9d2532044f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10134ebf-d745-4477-a897-f9372f03ed84]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:45:00 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:45:00 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:45:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:45:00 user nova-compute[72863]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 (non-flash)
Aug 15 13:45:00 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:45:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c25acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2'): ({'sde'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Removing single pathed devices sde {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0972e717-c392-4675-9d1f-d5a67f79c1d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33727a81-a09b-4e98-9fe9-fc4b41532b37]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flushing IO for device /dev/sde {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e7735-dc0a-4324-9c61-156bf6f23351]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[799abb01-0977-4a9a-a202-3965e168af0b]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] SCSI volumes sde have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7327ca-33da-4f68-996e-23b3697fee16]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b89cf3-edf1-4a27-ac6b-36dd69af9228]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260]
Aug 15 13:45:00 user nova-compute[72863]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2, portal: 172.16.0.220,3260] successful.
Aug 15 13:45:00 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06082b7-8a83-4d3c-98e2-5a8b8ff9b8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06824d08-1394-4613-b0c9-87c91e3b4f5a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] <== disconnect_volume: return (288ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:45:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:01 user nova-compute[72863]: DEBUG nova.objects.instance [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'flavor' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-22a5f07d-f536-4156-8c9a-991534cd48ae tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:04 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107089.9647405, 9fdc0841-80ef-48d8-83bc-db09fa20144e => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:04 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] VM Stopped (Lifecycle Event)
Aug 15 13:45:04 user nova-compute[72863]: DEBUG nova.compute.manager [None req-4cf86b8c-9c21-4326-a171-ff7839cffbae None None] [instance: 9fdc0841-80ef-48d8-83bc-db09fa20144e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:06 user nova-compute[72863]: INFO nova.compute.manager [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] instance snapshotting
Aug 15 13:45:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Beginning live snapshot process
Aug 15 13:45:06 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107091.516669, c88999a3-03bb-4966-abf4-9357e936bd2e => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:06 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] VM Stopped (Lifecycle Event)
Aug 15 13:45:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9eb7c489-da0e-4032-ac59-34de837c93eb None None] [instance: c88999a3-03bb-4966-abf4-9357e936bd2e] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json -f qcow2 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:06 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695.delta 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695.delta 1073741824" returned: 0 in 0.053s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 13:45:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:45:08 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72863) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 13:45:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 13:45:08 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:45:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695.delta /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:08 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695.delta /opt/stack/data/nova/instances/snapshots/tmpr5iuavk0/fe74876854a140d4b4e478d5c40b1695" returned: 0 in 0.276s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:08 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Snapshot extracted, beginning image upload
Aug 15 13:45:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Snapshot image upload complete
Aug 15 13:45:11 user nova-compute[72863]: INFO nova.compute.manager [None req-3e12801d-61fc-4b22-9643-333439181827 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Took 4.95 seconds to snapshot the instance on the hypervisor.
Aug 15 13:45:12 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107097.1148787, 807996dd-91e7-4cba-8f42-1d16be113184 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:12 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] VM Stopped (Lifecycle Event)
Aug 15 13:45:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bfe245d6-9abc-4462-aae6-ad9b8c17a32d None None] [instance: 807996dd-91e7-4cba-8f42-1d16be113184] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:45:13 user nova-compute[72863]: INFO nova.compute.claims [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Claim successful on node user
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:45:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.policy [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ea18fce6a0b49e5b5aa04ac0f207495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f13fc66607d40eaa9e8a3249110a8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:45:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Creating image(s)
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "/opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "/opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "/opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "147400f35c799cc3956ae69da966c55c8b25e799" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "147400f35c799cc3956ae69da966c55c8b25e799" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Successfully created port: bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG nova.virt.images [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] 55dcfd2b-c438-45bc-9ca1-93c63892bc71 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:45:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.part /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.part /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.converted" returned: 0 in 0.638s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:15 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "147400f35c799cc3956ae69da966c55c8b25e799" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.920s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Successfully updated port: bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquired lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "147400f35c799cc3956ae69da966c55c8b25e799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "147400f35c799cc3956ae69da966c55c8b25e799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing instance network info cache due to event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] Acquiring lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799,backing_fmt=raw /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799,backing_fmt=raw /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk 1073741824" returned: 0 in 0.055s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "147400f35c799cc3956ae69da966c55c8b25e799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'migration_context' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Ensure instance console log exists: /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Releasing lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Instance network_info: |[{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] Acquired lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.neutron [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Start _get_guest_xml network_info=[{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='31df61ccfaff948ddb175c62cde77358',container_format='bare',created_at=2023-08-15T13:45:06Z,direct_url=<?>,disk_format='qcow2',id=55dcfd2b-c438-45bc-9ca1-93c63892bc71,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1259100197',owner='1f13fc66607d40eaa9e8a3249110a8c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T13:45:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '55dcfd2b-c438-45bc-9ca1-93c63892bc71'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:45:16 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:45:16 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='31df61ccfaff948ddb175c62cde77358',container_format='bare',created_at=2023-08-15T13:45:06Z,direct_url=<?>,disk_format='qcow2',id=55dcfd2b-c438-45bc-9ca1-93c63892bc71,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1259100197',owner='1f13fc66607d40eaa9e8a3249110a8c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T13:45:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-173574353',display_name='tempest-TestStampPattern-server-173574353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-173574353',id=46,image_ref='55dcfd2b-c438-45bc-9ca1-93c63892bc71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-w86gxd1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9008be77-bd34-4015-94de-0c715cfc8e5d',image_min_disk='1',image_min_ram='0',image_owner_id='1f13fc66607d40eaa9e8a3249110a8c6',image_owner_project_name='tempest-TestStampPattern-1256330650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256330650-project-member',image_user_id='2ea18fce6a0b49e5b5aa04ac0f207495',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:45:14Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=91d135c7-8197-4ea2-b37b-c01cda558a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.objects.instance [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'pci_devices' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:45:16 user nova-compute[72863]:   <uuid>91d135c7-8197-4ea2-b37b-c01cda558a7d</uuid>
Aug 15 13:45:16 user nova-compute[72863]:   <name>instance-0000002e</name>
Aug 15 13:45:16 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:45:16 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:45:16 user nova-compute[72863]:   <metadata>
Aug 15 13:45:16 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:45:16 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:name>tempest-TestStampPattern-server-173574353</nova:name>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:45:16</nova:creationTime>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:45:16 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:45:16 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:owner>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:user uuid="2ea18fce6a0b49e5b5aa04ac0f207495">tempest-TestStampPattern-1256330650-project-member</nova:user>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:project uuid="1f13fc66607d40eaa9e8a3249110a8c6">tempest-TestStampPattern-1256330650</nova:project>
Aug 15 13:45:16 user nova-compute[72863]:       </nova:owner>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:root type="image" uuid="55dcfd2b-c438-45bc-9ca1-93c63892bc71"/>
Aug 15 13:45:16 user nova-compute[72863]:       <nova:ports>
Aug 15 13:45:16 user nova-compute[72863]:         <nova:port uuid="bd8ec743-a7da-4bb5-94e5-280c47d394db">
Aug 15 13:45:16 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 13:45:16 user nova-compute[72863]:         </nova:port>
Aug 15 13:45:16 user nova-compute[72863]:       </nova:ports>
Aug 15 13:45:16 user nova-compute[72863]:     </nova:instance>
Aug 15 13:45:16 user nova-compute[72863]:   </metadata>
Aug 15 13:45:16 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:45:16 user nova-compute[72863]:     <system>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="serial">91d135c7-8197-4ea2-b37b-c01cda558a7d</entry>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="uuid">91d135c7-8197-4ea2-b37b-c01cda558a7d</entry>
Aug 15 13:45:16 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:45:16 user nova-compute[72863]:     </system>
Aug 15 13:45:16 user nova-compute[72863]:   </sysinfo>
Aug 15 13:45:16 user nova-compute[72863]:   <os>
Aug 15 13:45:16 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:45:16 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:45:16 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:45:16 user nova-compute[72863]:   </os>
Aug 15 13:45:16 user nova-compute[72863]:   <features>
Aug 15 13:45:16 user nova-compute[72863]:     <acpi/>
Aug 15 13:45:16 user nova-compute[72863]:     <apic/>
Aug 15 13:45:16 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:45:16 user nova-compute[72863]:   </features>
Aug 15 13:45:16 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:45:16 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:45:16 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:45:16 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:45:16 user nova-compute[72863]:   </clock>
Aug 15 13:45:16 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:45:16 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:45:16 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:45:16 user nova-compute[72863]:   </cpu>
Aug 15 13:45:16 user nova-compute[72863]:   <devices>
Aug 15 13:45:16 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:45:16 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:45:16 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk"/>
Aug 15 13:45:16 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:45:16 user nova-compute[72863]:     </disk>
Aug 15 13:45:16 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:45:16 user nova-compute[72863]:       <mac address="fa:16:3e:d7:de:15"/>
Aug 15 13:45:16 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:45:16 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:45:16 user nova-compute[72863]:       <target dev="tapbd8ec743-a7"/>
Aug 15 13:45:16 user nova-compute[72863]:     </interface>
Aug 15 13:45:16 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:45:16 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/console.log" append="off"/>
Aug 15 13:45:16 user nova-compute[72863]:     </serial>
Aug 15 13:45:16 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:45:16 user nova-compute[72863]:     <video>
Aug 15 13:45:16 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:45:16 user nova-compute[72863]:     </video>
Aug 15 13:45:16 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:45:16 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:45:16 user nova-compute[72863]:     </rng>
Aug 15 13:45:16 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:45:16 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:45:16 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:45:16 user nova-compute[72863]:     </memballoon>
Aug 15 13:45:16 user nova-compute[72863]:   </devices>
Aug 15 13:45:16 user nova-compute[72863]: </domain>
Aug 15 13:45:16 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-173574353',display_name='tempest-TestStampPattern-server-173574353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-173574353',id=46,image_ref='55dcfd2b-c438-45bc-9ca1-93c63892bc71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-w86gxd1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9008be77-bd34-4015-94de-0c715cfc8e5d',image_min_disk='1',image_min_ram='0',image_owner_id='1f13fc66607d40eaa9e8a3249110a8c6',image_owner_project_name='tempest-TestStampPattern-1256330650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256330650-project-member',image_user_id='2ea18fce6a0b49e5b5aa04ac0f207495',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:45:14Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=91d135c7-8197-4ea2-b37b-c01cda558a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG os_vif [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8ec743-a7, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd8ec743-a7, col_values=(('external_ids', {'iface-id': 'bd8ec743-a7da-4bb5-94e5-280c47d394db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:de:15', 'vm-uuid': '91d135c7-8197-4ea2-b37b-c01cda558a7d'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:16 user nova-compute[72863]: INFO os_vif [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7')
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:45:16 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No VIF found with MAC fa:16:3e:d7:de:15, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updated VIF entry in instance network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8d721f80-d9a9-4e0b-8bd6-6b373a96d7ce req-d77faa40-be10-4c5a-8681-f8ecca5203d9 service nova] Releasing lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing instance network info cache due to event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updated VIF entry in instance network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG nova.network.neutron [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-adb02c32-01e4-46b9-9206-2787c3768675 req-f3c82595-7a44-4041-8116-f25e717eee69 service nova] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:17 user nova-compute[72863]: INFO nova.compute.manager [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Shelve offloading
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:18 user nova-compute[72863]: WARNING nova.compute.manager [req-6f47dee9-dc5f-4ac3-bbaa-e2aaad960bba req-1bc6063f-99ae-4ec1-847b-bdb119d014f4 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state active and task_state shelving.
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] No waiting events found dispatching network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:18 user nova-compute[72863]: WARNING nova.compute.manager [req-efbd0d0e-b001-4a97-b167-5a5a4a767ffb req-0332d4a2-5cf7-4797-9e5c-164c71701763 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received unexpected event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db for instance with vm_state building and task_state spawning.
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance destroyed successfully.
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:18 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:45:19 user nova-compute[72863]: DEBUG nova.network.neutron [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance destroyed successfully.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.objects.instance [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'resources' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUdOndPGjtkpy3AvPM2Qfj5GJ89Ka936KRsYI+Cp1/a+eX+x29hK//YCeCwEIGLeT5+9ifITnEksniwSBMuvLRSwT8rCdCMSxQkfVfUQnDrTT7VegCICLJA/n1bDFaXbA==',key_name='tempest-TestShelveInstance-838633721',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:43:42Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_vif [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf26e8f0-5a, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:20 user nova-compute[72863]: INFO os_vif [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a')
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:45:20 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea0c33-2612-47b2-bb04-9a19121a158c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d9159-21d5-4f21-8468-81108d5e21b0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:45:20 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:45:20 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:45:20 user nova-compute[72863]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:45:20 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5241e2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'): ({'sdf'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Removing single pathed devices sdf {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb59e40-7313-4da6-8fff-a456ff64ecb9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.122s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[577dc46c-0f33-47ae-9cd6-e63347459c3b]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flushing IO for device /dev/sdf {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fadfb70-9aab-4b1f-9587-5adf6b755754]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:20 user nova-compute[72863]: WARNING nova.compute.manager [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state active and task_state shelving.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing instance network info cache due to event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.network.neutron [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] No waiting events found dispatching network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:20 user nova-compute[72863]: WARNING nova.compute.manager [req-f2bc2257-6869-4794-8cf4-fee733f3944c req-84907f8c-22e3-413a-b0fb-55cd03b3f2fd service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received unexpected event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db for instance with vm_state building and task_state spawning.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.097s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b45a1-de06-435e-afc1-253dee48b3d6]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] SCSI volumes sdf have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[75628593-7580-4911-94e1-9c5027a00d37]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a3552-f5f7-45c1-aa46-245426af348d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]
Aug 15 13:45:20 user nova-compute[72863]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.
Aug 15 13:45:20 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814eee0-babb-4cd3-b8c2-c170bea8d7fd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== disconnect_volume: return (464ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deleting instance files /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be_del
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deletion of /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be_del complete
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107120.7158263, 91d135c7-8197-4ea2-b37b-c01cda558a7d => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] VM Resumed (Lifecycle Event)
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Instance spawned successfully.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107120.7194564, 91d135c7-8197-4ea2-b37b-c01cda558a7d => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] VM Started (Lifecycle Event)
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:20 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:45:20 user nova-compute[72863]: INFO nova.compute.manager [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Took 7.59 seconds to build instance.
Aug 15 13:45:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-17b8ccef-22ca-462d-85d3-804ac738aa97 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.705s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:21 user nova-compute[72863]: DEBUG nova.network.neutron [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updated VIF entry in instance network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:45:21 user nova-compute[72863]: DEBUG nova.network.neutron [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": null, "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-60c67c71-12c3-4543-b3c7-40c78e5f3299 req-4ad2b16b-d1cb-4353-9409-30b76459fa81 service nova] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:21 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Deleted allocations for instance 48312188-1fe8-4d83-b619-21dc0e8e98be
Aug 15 13:45:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'numa_topology' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b1cb04c1-7e71-4a04-bacc-7afa45c7d870 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.330s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:26 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:27 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:45:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:45:28 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.41571044921875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 772fe730-8857-4520-9006-3972b660b933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance eb797116-28dc-481b-af43-439920b4f269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 85dc30ef-6273-49a4-83e6-b265c44fa76a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 91d135c7-8197-4ea2-b37b-c01cda558a7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:45:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:33 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107118.8872757, 48312188-1fe8-4d83-b619-21dc0e8e98be => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:33 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Stopped (Lifecycle Event)
Aug 15 13:45:33 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cdf80dbe-f9c5-4bc8-bb6f-838de64ed92c None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:34 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:45:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:39 user nova-compute[72863]: INFO nova.compute.manager [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Terminating instance
Aug 15 13:45:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:45:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.compute.manager [req-85c0e873-cbfc-46f7-8647-4805f949ee45 req-69286517-50ed-47f2-9686-7591ab404ac0 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-unplugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Instance destroyed successfully.
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lazy-loading 'resources' on Instance uuid eb797116-28dc-481b-af43-439920b4f269 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1057708234',display_name='tempest-ServerRescueNegativeTestJSON-server-1057708234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1057708234',id=19,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5389f772e56e4039a074a8df8ba6cb05',ramdisk_id='',reservation_id='r-jyhasptx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1509280722',owner_user_name='tempest-ServerRescueNegativeTestJSON-1509280722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:35:11Z,user_data=None,user_id='46ca7fc8e0234907a0c702f5058880f1',uuid=eb797116-28dc-481b-af43-439920b4f269,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converting VIF {"id": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "address": "fa:16:3e:ed:e0:62", "network": {"id": "13ebf51c-47a9-4923-822e-32e27df3ad7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-934947658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5389f772e56e4039a074a8df8ba6cb05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598a82a2-20", "ovs_interfaceid": "598a82a2-20af-48a4-9465-b83e9d9e6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG os_vif [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598a82a2-20, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:40 user nova-compute[72863]: INFO os_vif [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e0:62,bridge_name='br-int',has_traffic_filtering=True,id=598a82a2-20af-48a4-9465-b83e9d9e6b70,network=Network(13ebf51c-47a9-4923-822e-32e27df3ad7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598a82a2-20')
Aug 15 13:45:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Deleting instance files /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269_del
Aug 15 13:45:40 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Deletion of /opt/stack/data/nova/instances/eb797116-28dc-481b-af43-439920b4f269_del complete
Aug 15 13:45:40 user nova-compute[72863]: INFO nova.compute.manager [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] [instance: eb797116-28dc-481b-af43-439920b4f269] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 13:45:40 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:45:40 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: eb797116-28dc-481b-af43-439920b4f269] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:45:41 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: eb797116-28dc-481b-af43-439920b4f269] Took 0.50 seconds to deallocate network for instance.
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:41 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Deleted allocations for instance eb797116-28dc-481b-af43-439920b4f269
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25ea97a1-8966-41a5-8aa0-cc414a9e5895 tempest-ServerRescueNegativeTestJSON-1509280722 tempest-ServerRescueNegativeTestJSON-1509280722-project-member] Lock "eb797116-28dc-481b-af43-439920b4f269" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:45:41 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:45:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] Acquiring lock "eb797116-28dc-481b-af43-439920b4f269-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] Lock "eb797116-28dc-481b-af43-439920b4f269-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] No waiting events found dispatching network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:42 user nova-compute[72863]: WARNING nova.compute.manager [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received unexpected event network-vif-plugged-598a82a2-20af-48a4-9465-b83e9d9e6b70 for instance with vm_state deleted and task_state None.
Aug 15 13:45:42 user nova-compute[72863]: DEBUG nova.compute.manager [req-fbcfb22f-e0f1-42bc-8539-8e4ab3c14cc1 req-2ff89cf7-187d-49a5-8c77-a0ce58e84543 service nova] [instance: eb797116-28dc-481b-af43-439920b4f269] Received event network-vif-deleted-598a82a2-20af-48a4-9465-b83e9d9e6b70 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "772fe730-8857-4520-9006-3972b660b933" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "772fe730-8857-4520-9006-3972b660b933-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:46 user nova-compute[72863]: INFO nova.compute.manager [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Terminating instance
Aug 15 13:45:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-unplugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] Acquiring lock "772fe730-8857-4520-9006-3972b660b933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] No waiting events found dispatching network-vif-unplugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-e82bbfe2-8f80-4d14-8c0f-732346299e6b req-ca870691-01ea-43b2-9cfb-29fbd14a8e84 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-unplugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:45:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 772fe730-8857-4520-9006-3972b660b933] Instance destroyed successfully.
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lazy-loading 'resources' on Instance uuid 772fe730-8857-4520-9006-3972b660b933 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1579148946',display_name='tempest-ServerActionsTestOtherA-server-1579148946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1579148946',id=17,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL53MW/ddfJf/h8R/1PsLNR3tET4toyVLPXlDeuHMU3qWnuOayV88wGyXqx/HMclsXKsQNqbfXblaapheesWF2XLG7hSRruvFkRh4A8jtt1VNxocFJDj3KlJ4Y8XPp3M9g==',key_name='tempest-keypair-840613809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8a87964e7845cba898b18f2d5021ec',ramdisk_id='',reservation_id='r-l8yoj568',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-278685911',owner_user_name='tempest-ServerActionsTestOtherA-278685911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d885a5f78b6e4c3c993fee958bee7cd0',uuid=772fe730-8857-4520-9006-3972b660b933,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converting VIF {"id": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "address": "fa:16:3e:98:9d:33", "network": {"id": "6aa12135-3048-4a5a-8560-b006e958793c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1746249178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8a87964e7845cba898b18f2d5021ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dceaaa1-f0", "ovs_interfaceid": "3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG os_vif [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dceaaa1-f0, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:47 user nova-compute[72863]: INFO os_vif [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:33,bridge_name='br-int',has_traffic_filtering=True,id=3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0,network=Network(6aa12135-3048-4a5a-8560-b006e958793c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dceaaa1-f0')
Aug 15 13:45:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Deleting instance files /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933_del
Aug 15 13:45:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Deletion of /opt/stack/data/nova/instances/772fe730-8857-4520-9006-3972b660b933_del complete
Aug 15 13:45:47 user nova-compute[72863]: INFO nova.compute.manager [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] [instance: 772fe730-8857-4520-9006-3972b660b933] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 13:45:47 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 772fe730-8857-4520-9006-3972b660b933] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:45:47 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 772fe730-8857-4520-9006-3972b660b933] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:45:48 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 772fe730-8857-4520-9006-3972b660b933] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:48 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 772fe730-8857-4520-9006-3972b660b933] Took 0.54 seconds to deallocate network for instance.
Aug 15 13:45:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:48 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:48 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Deleted allocations for instance 772fe730-8857-4520-9006-3972b660b933
Aug 15 13:45:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-dcc4a802-8b2c-4f77-97ae-33413a0a9b5c tempest-ServerActionsTestOtherA-278685911 tempest-ServerActionsTestOtherA-278685911-project-member] Lock "772fe730-8857-4520-9006-3972b660b933" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] Acquiring lock "772fe730-8857-4520-9006-3972b660b933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] Lock "772fe730-8857-4520-9006-3972b660b933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] No waiting events found dispatching network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:49 user nova-compute[72863]: WARNING nova.compute.manager [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received unexpected event network-vif-plugged-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 for instance with vm_state deleted and task_state None.
Aug 15 13:45:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-7c6e5273-805b-4bf6-a5d3-f056f1b88acc req-475017d5-13d0-4bfe-962b-499ecdfe6025 service nova] [instance: 772fe730-8857-4520-9006-3972b660b933] Received event network-vif-deleted-3dceaaa1-f0ca-4dd9-b8b2-4ee09072def0 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:50 user nova-compute[72863]: INFO nova.compute.manager [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Terminating instance
Aug 15 13:45:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-fe72cc46-de6a-49e7-8d40-f02d847bca49 req-14f1a800-5d96-4a2a-adbf-591631e496b7 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Instance destroyed successfully.
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.objects.instance [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'resources' on Instance uuid 85dc30ef-6273-49a4-83e6-b265c44fa76a {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1881959639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1881959639',id=39,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaEQf+iv7jk+vhXRxlt2Q0EclLPUbfCDR+F70dPACTSfRNTHdUhlgA5f0w58q5C749fYLq1XadjHSUVD33KbHoj5ukGwyT2pmVVR2PGHcdMSofoXH/9GcXCTagYLkLk5Q==',key_name='tempest-keypair-1575422208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:43:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-tpaqvg0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=85dc30ef-6273-49a4-83e6-b265c44fa76a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "address": "fa:16:3e:07:63:c0", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4cd9a00-f7", "ovs_interfaceid": "b4cd9a00-f7d3-46bd-af23-d896e94a02ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG os_vif [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4cd9a00-f7, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:45:52 user nova-compute[72863]: INFO os_vif [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:63:c0,bridge_name='br-int',has_traffic_filtering=True,id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4cd9a00-f7')
Aug 15 13:45:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Deleting instance files /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a_del
Aug 15 13:45:52 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Deletion of /opt/stack/data/nova/instances/85dc30ef-6273-49a4-83e6-b265c44fa76a_del complete
Aug 15 13:45:52 user nova-compute[72863]: INFO nova.compute.manager [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Took 2.04 seconds to destroy the instance on the hypervisor.
Aug 15 13:45:52 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:53 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Took 0.99 seconds to deallocate network for instance.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb43e8-58c8-46e5-b3be-71515b807199 req-f30e861e-eb3d-40ba-aeb7-9f0202449838 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-deleted-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: INFO nova.compute.manager [req-dbbb43e8-58c8-46e5-b3be-71515b807199 req-f30e861e-eb3d-40ba-aeb7-9f0202449838 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Neutron deleted interface b4cd9a00-f7d3-46bd-af23-d896e94a02ae; detaching it from the instance and deleting it from the info cache
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.network.neutron [req-dbbb43e8-58c8-46e5-b3be-71515b807199 req-f30e861e-eb3d-40ba-aeb7-9f0202449838 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-dbbb43e8-58c8-46e5-b3be-71515b807199 req-f30e861e-eb3d-40ba-aeb7-9f0202449838 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Detach interface failed, port_id=b4cd9a00-f7d3-46bd-af23-d896e94a02ae, reason: Instance 85dc30ef-6273-49a4-83e6-b265c44fa76a could not be found. {{(pid=72863) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:53 user nova-compute[72863]: WARNING nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state deleted and task_state None.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:53 user nova-compute[72863]: WARNING nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state deleted and task_state None.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:53 user nova-compute[72863]: WARNING nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state deleted and task_state None.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:53 user nova-compute[72863]: WARNING nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-unplugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state deleted and task_state None.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Acquiring lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: DEBUG nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] No waiting events found dispatching network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:45:53 user nova-compute[72863]: WARNING nova.compute.manager [req-b575895d-a1a9-4ebe-ac1f-784dc7f07f41 req-e7e8adb1-df9e-48c5-9498-189c98414497 service nova] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Received unexpected event network-vif-plugged-b4cd9a00-f7d3-46bd-af23-d896e94a02ae for instance with vm_state deleted and task_state None.
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:53 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Deleted allocations for instance 85dc30ef-6273-49a4-83e6-b265c44fa76a
Aug 15 13:45:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-b7c80685-bfab-418b-87ce-d3bb73fbee3d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "85dc30ef-6273-49a4-83e6-b265c44fa76a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.436s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:45:55 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107140.6537433, eb797116-28dc-481b-af43-439920b4f269 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:45:55 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: eb797116-28dc-481b-af43-439920b4f269] VM Stopped (Lifecycle Event)
Aug 15 13:45:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-3c444a81-ba0c-4f7d-97af-204122176bc3 None None] [instance: eb797116-28dc-481b-af43-439920b4f269] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:45:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing instance network info cache due to event network-changed-b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] Acquiring lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] Acquired lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Refreshing network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:02 user nova-compute[72863]: INFO nova.compute.manager [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Terminating instance
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107147.6134658, 772fe730-8857-4520-9006-3972b660b933 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:02 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 772fe730-8857-4520-9006-3972b660b933] VM Stopped (Lifecycle Event)
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.compute.manager [None req-fa923dc6-b7e7-4a8d-9111-ba4d24bb3f88 None None] [instance: 772fe730-8857-4520-9006-3972b660b933] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updated VIF entry in instance network info cache for port b29ebb52-5f5f-4418-ab49-b14444d2cf5f. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [{"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3f8db3b5-9ab9-4634-b17f-52a1f68ed659 req-4149c0cc-78bf-41a0-971b-3b1069973926 service nova] Releasing lock "refresh_cache-a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Instance destroyed successfully.
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lazy-loading 'resources' on Instance uuid a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-192197456',display_name='tempest-TestVolumeBootPattern-server-192197456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-192197456',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJMuQNMIarNG7KxQjD18PGRVn+8BuJAAdx3mfMakbUyi1BPtlveahNW+5as2NHLMsi1DQOmQb6vQt/jZt4UbKqQho67dzwTv0T/+5wX3SxgHag4zlezD7tntosYG9rAgw==',key_name='tempest-TestVolumeBootPattern-1020390988',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:41:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc53f1a137d047dc9e07af4222644667',ramdisk_id='',reservation_id='r-jrmyu6lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1735501215',owner_user_name='tempest-TestVolumeBootPattern-1735501215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:41:14Z,user_data=None,user_id='ff7112dd18c04b1c9ca951ba52bcf868',uuid=a3657ce0-ea19-4c4f-9102-3fabbbe72ed6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converting VIF {"id": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "address": "fa:16:3e:ab:27:e7", "network": {"id": "db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-935766877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc53f1a137d047dc9e07af4222644667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb29ebb52-5f", "ovs_interfaceid": "b29ebb52-5f5f-4418-ab49-b14444d2cf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_vif [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb29ebb52-5f, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:03 user nova-compute[72863]: INFO os_vif [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:27:e7,bridge_name='br-int',has_traffic_filtering=True,id=b29ebb52-5f5f-4418-ab49-b14444d2cf5f,network=Network(db36c1fd-aa8d-4b0a-938f-d3fa9e7d878d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb29ebb52-5f')
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFowmKsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:46:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d312a8-27f4-4eb7-a1c2-0d66c2dcec48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409396c0-546c-4d12-aa0b-50a97713fe1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0577df11-38bf-4cdf-bdfd-dd166b09a104]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409396c0-546c-4d12-aa0b-50a97713fe1a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:46:03 user nova-compute[72863]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409396c0-546c-4d12-aa0b-50a97713fe1a (non-flash)
Aug 15 13:46:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c (non-flash)
Aug 15 13:46:03 user nova-compute[72863]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409396c0-546c-4d12-aa0b-50a97713fe1a (non-flash)
Aug 15 13:46:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c700790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c321c9a8-a62b-4c95-8296-1441e9df9ec8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[836e2f15-c86a-4d89-b8a4-a87c6954afb6]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb1ee51-cbb1-4742-9567-c33e180e695a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d9657-bb78-44ad-9145-51618285aba1]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da96f1d-8956-45cc-8480-99aa468804a5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[badf5b09-77b9-4eb9-823b-749ec6c7f4b6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260]
Aug 15 13:46:03 user nova-compute[72863]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c, portal: 172.16.0.220,3260] successful.
Aug 15 13:46:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d69130-ff8d-4c4b-adad-c4b517a5b76c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce5f535-674c-440e-87d8-62f181cae89d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] <== disconnect_volume: return (340ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:46:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Deleting instance files /opt/stack/data/nova/instances/a3657ce0-ea19-4c4f-9102-3fabbbe72ed6_del
Aug 15 13:46:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Deletion of /opt/stack/data/nova/instances/a3657ce0-ea19-4c4f-9102-3fabbbe72ed6_del complete
Aug 15 13:46:03 user nova-compute[72863]: INFO nova.compute.manager [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 13:46:03 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:04 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Took 0.53 seconds to deallocate network for instance.
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-ff7f8bd1-eb55-4bb4-9c15-aa9ada5f9a0e req-74e4fe79-347e-400b-92e6-558d9209a8e6 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-deleted-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: WARNING nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state active and task_state deleting.
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: WARNING nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state active and task_state deleting.
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: WARNING nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state active and task_state deleting.
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-unplugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Acquiring lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] No waiting events found dispatching network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:04 user nova-compute[72863]: WARNING nova.compute.manager [req-61a833e6-865b-4275-bf64-c4ca61bd004c req-90eec303-0a44-4c78-9a6e-9edf37edd0e3 service nova] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Received unexpected event network-vif-plugged-b29ebb52-5f5f-4418-ab49-b14444d2cf5f for instance with vm_state active and task_state deleting.
Aug 15 13:46:04 user nova-compute[72863]: INFO nova.compute.manager [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:05 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:46:05 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:46:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:05 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Deleted allocations for instance a3657ce0-ea19-4c4f-9102-3fabbbe72ed6
Aug 15 13:46:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2434974b-2b08-4011-b474-da255982f8e2 tempest-TestVolumeBootPattern-1735501215 tempest-TestVolumeBootPattern-1735501215-project-member] Lock "a3657ce0-ea19-4c4f-9102-3fabbbe72ed6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.016s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:07 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107152.2341712, 85dc30ef-6273-49a4-83e6-b265c44fa76a => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:07 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] VM Stopped (Lifecycle Event)
Aug 15 13:46:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-628c60e0-1bd6-4c2f-908c-8937aa5b3f83 None None] [instance: 85dc30ef-6273-49a4-83e6-b265c44fa76a] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:46:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:18 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107163.184751, a3657ce0-ea19-4c4f-9102-3fabbbe72ed6 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:18 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] VM Stopped (Lifecycle Event)
Aug 15 13:46:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-33c05f68-d49b-48d8-8793-188f36912dfc None None] [instance: a3657ce0-ea19-4c4f-9102-3fabbbe72ed6] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:21 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:46:21 user nova-compute[72863]: INFO nova.compute.claims [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Claim successful on node user
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:46:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:46:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Creating image(s)
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "/opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "/opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG nova.policy [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f70234bcb0c84b1eb87ff2f3a22e28c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac6a82176e3475bbc302785544654b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk 1073741824" returned: 0 in 0.051s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.167s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Cannot resize image /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lazy-loading 'migration_context' on Instance uuid fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Ensure instance console log exists: /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:23 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Successfully created port: 1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Successfully updated port: 1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquired lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-changed-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Refreshing instance network info cache due to event network-changed-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] Acquiring lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.neutron [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Updating instance_info_cache with network_info: [{"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Releasing lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Instance network_info: |[{"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] Acquired lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.neutron [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Refreshing network info cache for port 1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Start _get_guest_xml network_info=[{"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:46:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:24 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519736000',display_name='tempest-VolumesNegativeTest-instance-519736000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519736000',id=47,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aac6a82176e3475bbc302785544654b5',ramdisk_id='',reservation_id='r-ii50r9dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2057164341',owner_user_name='tempest-VolumesNegativeTest-2057164341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:46:23Z,user_data=None,user_id='f70234bcb0c84b1eb87ff2f3a22e28c0',uuid=fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converting VIF {"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lazy-loading 'pci_devices' on Instance uuid fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:46:24 user nova-compute[72863]:   <uuid>fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd</uuid>
Aug 15 13:46:24 user nova-compute[72863]:   <name>instance-0000002f</name>
Aug 15 13:46:24 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:46:24 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:46:24 user nova-compute[72863]:   <metadata>
Aug 15 13:46:24 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:46:24 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:name>tempest-VolumesNegativeTest-instance-519736000</nova:name>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:46:24</nova:creationTime>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:46:24 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:46:24 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:owner>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:user uuid="f70234bcb0c84b1eb87ff2f3a22e28c0">tempest-VolumesNegativeTest-2057164341-project-member</nova:user>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:project uuid="aac6a82176e3475bbc302785544654b5">tempest-VolumesNegativeTest-2057164341</nova:project>
Aug 15 13:46:24 user nova-compute[72863]:       </nova:owner>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:46:24 user nova-compute[72863]:       <nova:ports>
Aug 15 13:46:24 user nova-compute[72863]:         <nova:port uuid="1c2822ac-1184-49cf-a1d2-ccf84a1d0e28">
Aug 15 13:46:24 user nova-compute[72863]:           <nova:ip type="fixed" address="192.168.233.163" ipVersion="4"/>
Aug 15 13:46:24 user nova-compute[72863]:         </nova:port>
Aug 15 13:46:24 user nova-compute[72863]:       </nova:ports>
Aug 15 13:46:24 user nova-compute[72863]:     </nova:instance>
Aug 15 13:46:24 user nova-compute[72863]:   </metadata>
Aug 15 13:46:24 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:46:24 user nova-compute[72863]:     <system>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="serial">fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd</entry>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="uuid">fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd</entry>
Aug 15 13:46:24 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:46:24 user nova-compute[72863]:     </system>
Aug 15 13:46:24 user nova-compute[72863]:   </sysinfo>
Aug 15 13:46:24 user nova-compute[72863]:   <os>
Aug 15 13:46:24 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:46:24 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:46:24 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:46:24 user nova-compute[72863]:   </os>
Aug 15 13:46:24 user nova-compute[72863]:   <features>
Aug 15 13:46:24 user nova-compute[72863]:     <acpi/>
Aug 15 13:46:24 user nova-compute[72863]:     <apic/>
Aug 15 13:46:24 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:46:24 user nova-compute[72863]:   </features>
Aug 15 13:46:24 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:46:24 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:46:24 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:46:24 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:46:24 user nova-compute[72863]:   </clock>
Aug 15 13:46:24 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:46:24 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:46:24 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:46:24 user nova-compute[72863]:   </cpu>
Aug 15 13:46:24 user nova-compute[72863]:   <devices>
Aug 15 13:46:24 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:46:24 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:46:24 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk"/>
Aug 15 13:46:24 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:46:24 user nova-compute[72863]:     </disk>
Aug 15 13:46:24 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:46:24 user nova-compute[72863]:       <mac address="fa:16:3e:aa:05:3a"/>
Aug 15 13:46:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:46:24 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:46:24 user nova-compute[72863]:       <target dev="tap1c2822ac-11"/>
Aug 15 13:46:24 user nova-compute[72863]:     </interface>
Aug 15 13:46:24 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:46:24 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/console.log" append="off"/>
Aug 15 13:46:24 user nova-compute[72863]:     </serial>
Aug 15 13:46:24 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:46:24 user nova-compute[72863]:     <video>
Aug 15 13:46:24 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:46:24 user nova-compute[72863]:     </video>
Aug 15 13:46:24 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:46:24 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:46:24 user nova-compute[72863]:     </rng>
Aug 15 13:46:24 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:46:24 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:46:24 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:46:24 user nova-compute[72863]:     </memballoon>
Aug 15 13:46:24 user nova-compute[72863]:   </devices>
Aug 15 13:46:24 user nova-compute[72863]: </domain>
Aug 15 13:46:24 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519736000',display_name='tempest-VolumesNegativeTest-instance-519736000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519736000',id=47,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aac6a82176e3475bbc302785544654b5',ramdisk_id='',reservation_id='r-ii50r9dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2057164341',owner_user_name='tempest-VolumesNegativeTest-2057164341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:46:23Z,user_data=None,user_id='f70234bcb0c84b1eb87ff2f3a22e28c0',uuid=fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converting VIF {"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG os_vif [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c2822ac-11, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c2822ac-11, col_values=(('external_ids', {'iface-id': '1c2822ac-1184-49cf-a1d2-ccf84a1d0e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:05:3a', 'vm-uuid': 'fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:24 user nova-compute[72863]: INFO os_vif [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11')
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:46:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] No VIF found with MAC fa:16:3e:aa:05:3a, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:46:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Updated VIF entry in instance network info cache for port 1c2822ac-1184-49cf-a1d2-ccf84a1d0e28. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:46:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Updating instance_info_cache with network_info: [{"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a52c2bb6-4f81-4154-8dc7-5394c7284954 req-1bb7e244-53ac-451b-9564-47d89dda6a81 service nova] Releasing lock "refresh_cache-fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] No waiting events found dispatching network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:26 user nova-compute[72863]: WARNING nova.compute.manager [req-5a871ec2-781a-44e6-a1bd-d45682b52cbd req-e843ccdc-262e-418b-8b5e-d14a34872064 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received unexpected event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 for instance with vm_state building and task_state spawning.
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107188.4510026, fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] VM Resumed (Lifecycle Event)
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Instance spawned successfully.
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107188.451961, fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] VM Started (Lifecycle Event)
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG nova.compute.manager [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] No waiting events found dispatching network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:28 user nova-compute[72863]: WARNING nova.compute.manager [req-fe86fa96-ecfb-4d82-b5ab-ff45f3b381db req-25256293-c2e8-435a-937f-10711cdb543c service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received unexpected event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 for instance with vm_state building and task_state spawning.
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:28 user nova-compute[72863]: INFO nova.compute.manager [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Took 6.88 seconds to build instance.
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0cbf59cb-2057-4ce1-bbed-933816d74b5f tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.975s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:28 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:29 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=25.4873046875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 91d135c7-8197-4ea2-b37b-c01cda558a7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:46:29 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:46:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:46:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:46:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:46:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:46:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:46:45 user nova-compute[72863]: INFO nova.compute.claims [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Claim successful on node user
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:46:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.policy [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68d851d4db5542b889871f7300ad5158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9a115e03e455bb340a4b23376c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:46:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Creating image(s)
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.184s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk 1073741824" returned: 0 in 0.052s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Successfully created port: 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Cannot resize image /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'migration_context' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Ensure instance console log exists: /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Successfully updated port: 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.compute.manager [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing instance network info cache due to event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance network_info: |[{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start _get_guest_xml network_info=[{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:46:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhUCsfWkvuOdWh66EF/8BhTYwlZppWqIJAQPYxny5w4MKZ9Hthw8t1Tf4VAHHubrvYOTdxg9Q8mThRvF1iBtqQQR5P4s4tH5Rkxkp+JhPaEi2yFKb2N+IMcLTIMuvyczg==',key_name='tempest-keypair-2095236787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_devices' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:46:47 user nova-compute[72863]:   <uuid>770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</uuid>
Aug 15 13:46:47 user nova-compute[72863]:   <name>instance-00000030</name>
Aug 15 13:46:47 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:46:47 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:46:47 user nova-compute[72863]:   <metadata>
Aug 15 13:46:47 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:46:47 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-375961415</nova:name>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:46:47</nova:creationTime>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:46:47 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:46:47 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:owner>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:user uuid="68d851d4db5542b889871f7300ad5158">tempest-AttachVolumeShelveTestJSON-69904858-project-member</nova:user>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:project uuid="2cc9a115e03e455bb340a4b23376c4c5">tempest-AttachVolumeShelveTestJSON-69904858</nova:project>
Aug 15 13:46:47 user nova-compute[72863]:       </nova:owner>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:46:47 user nova-compute[72863]:       <nova:ports>
Aug 15 13:46:47 user nova-compute[72863]:         <nova:port uuid="491684ab-fe8a-441f-ad0e-860b53b5cb13">
Aug 15 13:46:47 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 13:46:47 user nova-compute[72863]:         </nova:port>
Aug 15 13:46:47 user nova-compute[72863]:       </nova:ports>
Aug 15 13:46:47 user nova-compute[72863]:     </nova:instance>
Aug 15 13:46:47 user nova-compute[72863]:   </metadata>
Aug 15 13:46:47 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:46:47 user nova-compute[72863]:     <system>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="serial">770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</entry>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="uuid">770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</entry>
Aug 15 13:46:47 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:46:47 user nova-compute[72863]:     </system>
Aug 15 13:46:47 user nova-compute[72863]:   </sysinfo>
Aug 15 13:46:47 user nova-compute[72863]:   <os>
Aug 15 13:46:47 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:46:47 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:46:47 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:46:47 user nova-compute[72863]:   </os>
Aug 15 13:46:47 user nova-compute[72863]:   <features>
Aug 15 13:46:47 user nova-compute[72863]:     <acpi/>
Aug 15 13:46:47 user nova-compute[72863]:     <apic/>
Aug 15 13:46:47 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:46:47 user nova-compute[72863]:   </features>
Aug 15 13:46:47 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:46:47 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:46:47 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:46:47 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:46:47 user nova-compute[72863]:   </clock>
Aug 15 13:46:47 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:46:47 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:46:47 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:46:47 user nova-compute[72863]:   </cpu>
Aug 15 13:46:47 user nova-compute[72863]:   <devices>
Aug 15 13:46:47 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:46:47 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:46:47 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk"/>
Aug 15 13:46:47 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:46:47 user nova-compute[72863]:     </disk>
Aug 15 13:46:47 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:46:47 user nova-compute[72863]:       <mac address="fa:16:3e:44:0f:59"/>
Aug 15 13:46:47 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:46:47 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:46:47 user nova-compute[72863]:       <target dev="tap491684ab-fe"/>
Aug 15 13:46:47 user nova-compute[72863]:     </interface>
Aug 15 13:46:47 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:46:47 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/console.log" append="off"/>
Aug 15 13:46:47 user nova-compute[72863]:     </serial>
Aug 15 13:46:47 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:46:47 user nova-compute[72863]:     <video>
Aug 15 13:46:47 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:46:47 user nova-compute[72863]:     </video>
Aug 15 13:46:47 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:46:47 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:46:47 user nova-compute[72863]:     </rng>
Aug 15 13:46:47 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:46:47 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:46:47 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:46:47 user nova-compute[72863]:     </memballoon>
Aug 15 13:46:47 user nova-compute[72863]:   </devices>
Aug 15 13:46:47 user nova-compute[72863]: </domain>
Aug 15 13:46:47 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhUCsfWkvuOdWh66EF/8BhTYwlZppWqIJAQPYxny5w4MKZ9Hthw8t1Tf4VAHHubrvYOTdxg9Q8mThRvF1iBtqQQR5P4s4tH5Rkxkp+JhPaEi2yFKb2N+IMcLTIMuvyczg==',key_name='tempest-keypair-2095236787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG os_vif [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491684ab-fe, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap491684ab-fe, col_values=(('external_ids', {'iface-id': '491684ab-fe8a-441f-ad0e-860b53b5cb13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:0f:59', 'vm-uuid': '770f02d7-038d-4bb6-a4ce-4c1d50d88b3b'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:47 user nova-compute[72863]: INFO os_vif [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe')
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No VIF found with MAC fa:16:3e:44:0f:59, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updated VIF entry in instance network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:46:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:46:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b66352ba-a027-4529-b49b-2a68c37df910 req-5634f2d6-6fb6-4919-b74f-5cd0ccab790f service nova] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:46:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:49 user nova-compute[72863]: WARNING nova.compute.manager [req-d147e850-c637-430e-82ea-d73a350b4a99 req-e89267d5-4edd-4fc9-aa26-cc354567af9f service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state building and task_state spawning.
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107211.2184682, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Resumed (Lifecycle Event)
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance spawned successfully.
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107211.2221484, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Started (Lifecycle Event)
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:51 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:46:51 user nova-compute[72863]: WARNING nova.compute.manager [req-ee5f2638-5f89-4eea-a184-e825b93c9808 req-5c874ad9-93e0-4e0a-aa6f-a6b2e6dc8094 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state building and task_state spawning.
Aug 15 13:46:51 user nova-compute[72863]: INFO nova.compute.manager [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Took 6.28 seconds to build instance.
Aug 15 13:46:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-25b42a7d-9532-4a44-bd70-1a8108abaa6a tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.374s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:46:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:46:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:47:05 user nova-compute[72863]: DEBUG nova.compute.manager [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing instance network info cache due to event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:47:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] Acquiring lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:47:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] Acquired lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:47:05 user nova-compute[72863]: DEBUG nova.network.neutron [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:47:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updated VIF entry in instance network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:47:06 user nova-compute[72863]: DEBUG nova.network.neutron [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:47:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-61150330-1c02-458a-af02-db98228f6394 req-6c0c197a-266e-4d29-a9c1-3d0141e24e16 service nova] Releasing lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:47:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:07 user nova-compute[72863]: INFO nova.compute.manager [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Attaching volume a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa to /dev/vdb
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.utils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5be104-afe3-4586-80b5-4a062ac75c5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e961b2-a400-414d-bde8-af8288e443c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10991964-8b4b-46d8-8008-e21daedbef5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f06ddf-963a-4320-bbb1-a63db9a7dce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:47:07 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:47:07 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f5deb8-97fc-42da-aacb-16615c260be4]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG os_brick.utils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating existing volume attachment record: 83f515a9-a1f8-415f-8d37-de8939182b23 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:47:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:10 user nova-compute[72863]: INFO nova.compute.manager [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Unshelving
Aug 15 13:47:10 user nova-compute[72863]: INFO nova.virt.block_device [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Booting with volume ee8311de-bf99-4408-8d50-880ca640621a at /dev/vda
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.utils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1698b-fc5d-419c-8261-6dbbd7676155]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd97f046-e9b6-4053-8d94-38f8bfb5b7b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b35ab1-ee31-4937-97bf-2d4bbdcf3b93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a69471d-aa89-468f-8a74-a140db2ce54c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:47:10 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:47:10 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b04bd3-4b26-4783-8fb0-c6beb8e1212f]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG os_brick.utils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:47:10 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating existing volume attachment record: da9b21dd-696c-47f4-9284-eb8d2acdd926 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:47:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USqwfuWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:47:17 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:47:17 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:47:17 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35285b8f-4786-4e35-a49a-d86f1e05cbae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:47:17 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318cac3-ca99-4f90-8452-43686cabd1b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa] added
Aug 15 13:47:17 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6cb764-4706-4e7d-9950-d78d742f0306]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a1b37-68d7-46d9-a11f-7393c1980546]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USqwfuWM {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USqwfuWM" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ae167-3a1b-41df-bb34-a140382ea386]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USqwfuWM'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5023be-a8d0-4391-aca8-5780c6d9e860]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c8829f-e772-458d-acd3-f6697c840ed1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:47:17 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:47:17 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:47:17 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:47:17 user nova-compute[72863]: 
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc1bcd-6631-4e23-8112-95646b5274c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260]
Aug 15 13:47:17 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260] successful.
Aug 15 13:47:17 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe152b0-606c-47f2-a7b6-bcfeea96f2ea]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25564851-f09b-4c5b-89f6-a6168cbfc9a2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:17 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:17 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59408cea-8090-4cc5-9b7d-0ebc7912c260]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USqwfuWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:47:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:47:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23861623561383265', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:47:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861623561383265', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:47:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:47:18 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:47:18 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:47:18 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:47:18 user nova-compute[72863]:   <serial>a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa</serial>
Aug 15 13:47:18 user nova-compute[72863]: </disk>
Aug 15 13:47:18 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] No VIF found with MAC fa:16:3e:d7:de:15, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-76161393-72eb-4067-b3d5-a527db29ec64 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.876s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.objects.instance [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'pci_requests' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.objects.instance [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'numa_topology' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:19 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:47:19 user nova-compute[72863]: INFO nova.compute.claims [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Claim successful on node user
Aug 15 13:47:20 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:47:20 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:47:20 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:20 user nova-compute[72863]: INFO nova.network.neutron [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.network.neutron [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:47:21 user nova-compute[72863]: INFO nova.compute.manager [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Detaching volume a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.compute.manager [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing instance network info cache due to event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:47:21 user nova-compute[72863]: INFO nova.virt.block_device [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Attempting to driver detach volume a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa from mountpoint /dev/vdb
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Attempting to detach device vdb from instance 91d135c7-8197-4ea2-b37b-c01cda558a7d from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:47:21 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:47:21 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:47:21 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:47:21 user nova-compute[72863]:   <serial>a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa</serial>
Aug 15 13:47:21 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:47:21 user nova-compute[72863]: </disk>
Aug 15 13:47:21 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:47:21 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully detached device vdb from instance 91d135c7-8197-4ea2-b37b-c01cda558a7d from the persistent domain config.
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91d135c7-8197-4ea2-b37b-c01cda558a7d from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:47:21 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:47:21 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:47:21 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:47:21 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:47:21 user nova-compute[72863]:   <serial>a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa</serial>
Aug 15 13:47:21 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:47:21 user nova-compute[72863]: </disk>
Aug 15 13:47:21 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.network.neutron [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:47:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Creating image(s)
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Did not create local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Ensure instance console log exists: /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start _get_guest_xml network_info=[{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da9b21dd-696c-47f4-9284-eb8d2acdd926', 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48312188-1fe8-4d83-b619-21dc0e8e98be', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee8311de-bf99-4408-8d50-880ca640621a', 'serial': 'ee8311de-bf99-4408-8d50-880ca640621a'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:47:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:47:22 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.objects.instance [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:47:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:47:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:47:22 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107242.1375508, 91d135c7-8197-4ea2-b37b-c01cda558a7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully detached device vdb from instance 91d135c7-8197-4ea2-b37b-c01cda558a7d from the live domain config.
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USqwfuWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:47:22 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e383fcc-eb77-43ec-b3e8-51d36afddd72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:47:22 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c04f5d8-8011-44f9-b008-88509c4c08a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a] added
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad89801-29fc-4d04-a9f3-9e4e29bd0df1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d36855-c2b9-43be-aeef-8e80f1d115fa]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oILHdhkB {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oILHdhkB" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd9a09b-19c9-4ade-b656-c3706c184b43]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oILHdhkB'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db1dfe3-5d3d-4353-9829-118527c619e8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3acc35-506d-440e-b983-696be738df63]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336556d-385a-425b-b465-154c51399100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]
Aug 15 13:47:22 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e1f568-8156-463a-ad1f-9b5271a1b35c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5076131-b82f-40df-916e-64205b3f2fe8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:22 user nova-compute[72863]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:22 user nova-compute[72863]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:47:22 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ecf4d-be29-459e-805b-af6bfcd2a6e3]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updated VIF entry in instance network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG nova.network.neutron [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f90435d8-120e-45b0-8d96-f814021f117f req-f46e7fc3-3fc9-4052-b0f7-fcb67be93eec service nova] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26666333961306631', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333961306631', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.395s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5294b712-ccb4-4591-8fc7-a96ef057aaf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-838633721',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:47:10Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.objects.instance [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'pci_devices' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:47:23 user nova-compute[72863]:   <uuid>48312188-1fe8-4d83-b619-21dc0e8e98be</uuid>
Aug 15 13:47:23 user nova-compute[72863]:   <name>instance-0000002d</name>
Aug 15 13:47:23 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:47:23 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:47:23 user nova-compute[72863]:   <metadata>
Aug 15 13:47:23 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:47:23 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:47:23 user nova-compute[72863]:       <nova:name>tempest-TestShelveInstance-server-1126009146</nova:name>
Aug 15 13:47:23 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:47:22</nova:creationTime>
Aug 15 13:47:23 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:47:23 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:47:23 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:47:23 user nova-compute[72863]:       <nova:owner>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:user uuid="9ad4bb906fef4b7baa9d97acdc711574">tempest-TestShelveInstance-144861718-project-member</nova:user>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:project uuid="3e0e885268a846f29fc247590d7c890e">tempest-TestShelveInstance-144861718</nova:project>
Aug 15 13:47:23 user nova-compute[72863]:       </nova:owner>
Aug 15 13:47:23 user nova-compute[72863]:       <nova:ports>
Aug 15 13:47:23 user nova-compute[72863]:         <nova:port uuid="cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d">
Aug 15 13:47:23 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 13:47:23 user nova-compute[72863]:         </nova:port>
Aug 15 13:47:23 user nova-compute[72863]:       </nova:ports>
Aug 15 13:47:23 user nova-compute[72863]:     </nova:instance>
Aug 15 13:47:23 user nova-compute[72863]:   </metadata>
Aug 15 13:47:23 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:47:23 user nova-compute[72863]:     <system>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="serial">48312188-1fe8-4d83-b619-21dc0e8e98be</entry>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="uuid">48312188-1fe8-4d83-b619-21dc0e8e98be</entry>
Aug 15 13:47:23 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:47:23 user nova-compute[72863]:     </system>
Aug 15 13:47:23 user nova-compute[72863]:   </sysinfo>
Aug 15 13:47:23 user nova-compute[72863]:   <os>
Aug 15 13:47:23 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:47:23 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:47:23 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:47:23 user nova-compute[72863]:   </os>
Aug 15 13:47:23 user nova-compute[72863]:   <features>
Aug 15 13:47:23 user nova-compute[72863]:     <acpi/>
Aug 15 13:47:23 user nova-compute[72863]:     <apic/>
Aug 15 13:47:23 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:47:23 user nova-compute[72863]:   </features>
Aug 15 13:47:23 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:47:23 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:47:23 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:47:23 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:47:23 user nova-compute[72863]:   </clock>
Aug 15 13:47:23 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:47:23 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:47:23 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:47:23 user nova-compute[72863]:   </cpu>
Aug 15 13:47:23 user nova-compute[72863]:   <devices>
Aug 15 13:47:23 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:47:23 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:47:23 user nova-compute[72863]:       <source dev="/dev/sdc"/>
Aug 15 13:47:23 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:47:23 user nova-compute[72863]:       <serial>ee8311de-bf99-4408-8d50-880ca640621a</serial>
Aug 15 13:47:23 user nova-compute[72863]:     </disk>
Aug 15 13:47:23 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:47:23 user nova-compute[72863]:       <mac address="fa:16:3e:fc:f4:db"/>
Aug 15 13:47:23 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:47:23 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:47:23 user nova-compute[72863]:       <target dev="tapcf26e8f0-5a"/>
Aug 15 13:47:23 user nova-compute[72863]:     </interface>
Aug 15 13:47:23 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:47:23 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be/console.log" append="off"/>
Aug 15 13:47:23 user nova-compute[72863]:     </serial>
Aug 15 13:47:23 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:47:23 user nova-compute[72863]:     <video>
Aug 15 13:47:23 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:47:23 user nova-compute[72863]:     </video>
Aug 15 13:47:23 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:47:23 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:47:23 user nova-compute[72863]:     </rng>
Aug 15 13:47:23 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:47:23 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:47:23 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:47:23 user nova-compute[72863]:     </memballoon>
Aug 15 13:47:23 user nova-compute[72863]:   </devices>
Aug 15 13:47:23 user nova-compute[72863]: </domain>
Aug 15 13:47:23 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-838633721',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:47:10Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_vif [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7562ed-965e-43c7-a3db-17bf55458f4a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:23 user nova-compute[72863]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:47:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa (non-flash)
Aug 15 13:47:23 user nova-compute[72863]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:47:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff524078a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf26e8f0-5a, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf26e8f0-5a, col_values=(('external_ids', {'iface-id': 'cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f4:db', 'vm-uuid': '48312188-1fe8-4d83-b619-21dc0e8e98be'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:23 user nova-compute[72863]: INFO os_vif [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a')
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c0a0f-e368-4d13-880c-5e7e1d602a37]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a4c53-79a1-4ae7-966e-1e810f406eb9]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd23d43-79b8-4297-8d99-d73df7b53d3b]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] No VIF found with MAC fa:16:3e:fc:f4:db, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e29ee6-5fde-4dc0-a4e2-d3e60fe687c2]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b1ba33-f802-4a40-a401-289f128df67f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[051966c5-d4de-47dc-bc30-0ad7820fef9a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260]
Aug 15 13:47:23 user nova-compute[72863]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa, portal: 172.16.0.220,3260] successful.
Aug 15 13:47:23 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0eaad10-4e3d-4ffe-9aba-e8ecbbeb82fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50de43-8e6b-47e1-8046-6adf72862186]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] <== disconnect_volume: return (1715ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:47:23 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:47:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'flavor' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:47:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e0f63b3f-dd0e-404e-9135-a32358eafbe5 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.170s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:47:25 user nova-compute[72863]: WARNING nova.compute.manager [req-7419c134-e183-47f2-bb04-c234b781f6e9 req-da291b12-5eeb-46e3-a21c-70f59c79aac2 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107247.3454583, 48312188-1fe8-4d83-b619-21dc0e8e98be => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:47:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Resumed (Lifecycle Event)
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:47:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance spawned successfully.
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:47:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107247.3473735, 48312188-1fe8-4d83-b619-21dc0e8e98be => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:47:27 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Started (Lifecycle Event)
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:47:27 user nova-compute[72863]: WARNING nova.compute.manager [req-8e6e11db-542b-47d9-aeeb-c7b60b82b8ee req-c3aa602e-bc45-4998-8d85-09318d364055 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:47:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-42801c30-48d6-4525-9f6f-fa1bf507ddca tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.328s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:31 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:47:31 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8066MB free_disk=25.416080474853516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 91d135c7-8197-4ea2-b37b-c01cda558a7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 48312188-1fe8-4d83-b619-21dc0e8e98be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:47:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:47:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:47:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:47:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:47:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:47:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:47:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:48:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:11 user nova-compute[72863]: INFO nova.compute.manager [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Terminating instance
Aug 15 13:48:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-unplugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] No waiting events found dispatching network-vif-unplugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-672458f2-80e9-499a-aa65-839a6e65f289 req-1bd05af9-abea-4d34-a5f2-1ff1d2378525 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-unplugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:48:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Instance destroyed successfully.
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lazy-loading 'resources' on Instance uuid fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519736000',display_name='tempest-VolumesNegativeTest-instance-519736000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519736000',id=47,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aac6a82176e3475bbc302785544654b5',ramdisk_id='',reservation_id='r-ii50r9dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2057164341',owner_user_name='tempest-VolumesNegativeTest-2057164341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:46:29Z,user_data=None,user_id='f70234bcb0c84b1eb87ff2f3a22e28c0',uuid=fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converting VIF {"id": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "address": "fa:16:3e:aa:05:3a", "network": {"id": "f55994f5-47a9-41d8-9ae5-64053ea69d0d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "34ec976ddcb840c4b421dc37e82bc3e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c2822ac-11", "ovs_interfaceid": "1c2822ac-1184-49cf-a1d2-ccf84a1d0e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG os_vif [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c2822ac-11, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: INFO os_vif [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c2822ac-1184-49cf-a1d2-ccf84a1d0e28,network=Network(f55994f5-47a9-41d8-9ae5-64053ea69d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c2822ac-11')
Aug 15 13:48:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Deleting instance files /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd_del
Aug 15 13:48:12 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Deletion of /opt/stack/data/nova/instances/fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd_del complete
Aug 15 13:48:12 user nova-compute[72863]: INFO nova.compute.manager [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing instance network info cache due to event network-changed-bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] Acquiring lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] Acquired lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.network.neutron [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Refreshing network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:12 user nova-compute[72863]: INFO nova.compute.manager [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Terminating instance
Aug 15 13:48:12 user nova-compute[72863]: DEBUG nova.compute.manager [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.neutron [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updated VIF entry in instance network info cache for port bd8ec743-a7da-4bb5-94e5-280c47d394db. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.neutron [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [{"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b7ec9de4-8201-446f-844a-cda6b91970bd req-a13d6418-4cdd-4ece-a315-81c4c3b4a894 service nova] Releasing lock "refresh_cache-91d135c7-8197-4ea2-b37b-c01cda558a7d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Instance destroyed successfully.
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.objects.instance [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'resources' on Instance uuid 91d135c7-8197-4ea2-b37b-c01cda558a7d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-173574353',display_name='tempest-TestStampPattern-server-173574353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-173574353',id=46,image_ref='55dcfd2b-c438-45bc-9ca1-93c63892bc71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-w86gxd1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9008be77-bd34-4015-94de-0c715cfc8e5d',image_min_disk='1',image_min_ram='0',image_owner_id='1f13fc66607d40eaa9e8a3249110a8c6',image_owner_project_name='tempest-TestStampPattern-1256330650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256330650-project-member',image_user_id='2ea18fce6a0b49e5b5aa04ac0f207495',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:45:21Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=91d135c7-8197-4ea2-b37b-c01cda558a7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "address": "fa:16:3e:d7:de:15", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8ec743-a7", "ovs_interfaceid": "bd8ec743-a7da-4bb5-94e5-280c47d394db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG os_vif [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8ec743-a7, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:13 user nova-compute[72863]: INFO os_vif [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:de:15,bridge_name='br-int',has_traffic_filtering=True,id=bd8ec743-a7da-4bb5-94e5-280c47d394db,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8ec743-a7')
Aug 15 13:48:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Deleting instance files /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d_del
Aug 15 13:48:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Deletion of /opt/stack/data/nova/instances/91d135c7-8197-4ea2-b37b-c01cda558a7d_del complete
Aug 15 13:48:13 user nova-compute[72863]: INFO nova.compute.manager [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 13:48:13 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:13 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Took 1.28 seconds to deallocate network for instance.
Aug 15 13:48:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Deleted allocations for instance fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] Acquiring lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] No waiting events found dispatching network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:14 user nova-compute[72863]: WARNING nova.compute.manager [req-bb5146d2-6ae8-4f2a-85b2-6cfbed9f2d98 req-760191d3-0b68-478b-967c-63510878dc49 service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received unexpected event network-vif-plugged-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 for instance with vm_state deleted and task_state None.
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7bad99bd-095a-4e18-8586-0255ca1d83e4 tempest-VolumesNegativeTest-2057164341 tempest-VolumesNegativeTest-2057164341-project-member] Lock "fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.496s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:14 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Took 0.75 seconds to deallocate network for instance.
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-444d0917-0879-4703-a9c5-bd53ee0c4664 req-c401d570-3ab9-4c4f-889b-655e9aaff644 service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-vif-deleted-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Deleted allocations for instance 91d135c7-8197-4ea2-b37b-c01cda558a7d
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-vif-unplugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] No waiting events found dispatching network-vif-unplugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:14 user nova-compute[72863]: WARNING nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received unexpected event network-vif-unplugged-bd8ec743-a7da-4bb5-94e5-280c47d394db for instance with vm_state deleted and task_state None.
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Received event network-vif-deleted-1c2822ac-1184-49cf-a1d2-ccf84a1d0e28 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Acquiring lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] No waiting events found dispatching network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:14 user nova-compute[72863]: WARNING nova.compute.manager [req-3ff0cbab-143e-4e81-985a-f13a25a26626 req-4c3a77b7-cb88-49df-a8a7-ebd2a8ff496a service nova] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Received unexpected event network-vif-plugged-bd8ec743-a7da-4bb5-94e5-280c47d394db for instance with vm_state deleted and task_state None.
Aug 15 13:48:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-532df033-a84e-4644-a0c8-3035b9c4ef12 tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "91d135c7-8197-4ea2-b37b-c01cda558a7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:27 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107292.5058022, fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:48:27 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] VM Stopped (Lifecycle Event)
Aug 15 13:48:27 user nova-compute[72863]: DEBUG nova.compute.manager [None req-9751b264-9789-4718-846a-445ca5d30432 None None] [instance: fdb1a2c8-c9a1-4f57-87bf-bfffde5c01cd] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:48:28 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107293.5841808, 91d135c7-8197-4ea2-b37b-c01cda558a7d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:48:28 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] VM Stopped (Lifecycle Event)
Aug 15 13:48:28 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6ace9a80-47dc-4047-aeb9-125a02644925 None None] [instance: 91d135c7-8197-4ea2-b37b-c01cda558a7d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:48:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:29 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:30 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:48:30 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=25.44222640991211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 9008be77-bd34-4015-94de-0c715cfc8e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 48312188-1fe8-4d83-b619-21dc0e8e98be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:48:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:35 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG nova.compute.manager [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing instance network info cache due to event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:36 user nova-compute[72863]: DEBUG nova.network.neutron [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updated VIF entry in instance network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-74433e64-b43a-49f0-91b2-562318523b9a req-2d85a2fe-ce5f-4439-9f73-1bf7e0884cf8 service nova] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:41 user nova-compute[72863]: INFO nova.compute.manager [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Shelving
Aug 15 13:48:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance destroyed successfully.
Aug 15 13:48:41 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Beginning cold snapshot process
Aug 15 13:48:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk /opt/stack/data/nova/instances/snapshots/tmpywjwvr69/72be956ab8d7482b8564f8dc62804f57 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk /opt/stack/data/nova/instances/snapshots/tmpywjwvr69/72be956ab8d7482b8564f8dc62804f57" returned: 0 in 0.410s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:42 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Snapshot extracted, beginning image upload
Aug 15 13:48:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:43 user nova-compute[72863]: DEBUG nova.compute.manager [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:43 user nova-compute[72863]: WARNING nova.compute.manager [req-b4ed3a5e-606e-4f3c-a01a-e436abdbaba0 req-a133ac05-2d95-425c-bdf1-8fdadabcf6a3 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 13:48:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Snapshot image upload complete
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:48:45 user nova-compute[72863]: INFO nova.compute.manager [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Shelve offloading
Aug 15 13:48:45 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance destroyed successfully.
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:45 user nova-compute[72863]: DEBUG nova.compute.manager [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:45 user nova-compute[72863]: WARNING nova.compute.manager [req-62ede696-f8c2-4b49-a260-8d6abbf0b163 req-f7cb66ee-bfe5-4a08-8d0f-e988114444ea service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state shelved and task_state shelving_offloading.
Aug 15 13:48:46 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance destroyed successfully.
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'resources' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhUCsfWkvuOdWh66EF/8BhTYwlZppWqIJAQPYxny5w4MKZ9Hthw8t1Tf4VAHHubrvYOTdxg9Q8mThRvF1iBtqQQR5P4s4tH5Rkxkp+JhPaEi2yFKb2N+IMcLTIMuvyczg==',key_name='tempest-keypair-2095236787',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:48:45.069131',shelved_host='user',shelved_image_id='04bf2123-07af-4ffb-aecc-a25e464ed629'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG os_vif [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491684ab-fe, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing instance network info cache due to event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:46 user nova-compute[72863]: INFO os_vif [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe')
Aug 15 13:48:46 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Deleting instance files /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b_del
Aug 15 13:48:46 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Deletion of /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b_del complete
Aug 15 13:48:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:46 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Deleted allocations for instance 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.objects.instance [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'numa_topology' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-c0e0f12c-1d76-4c86-a8ec-a518adbae519 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.491s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updated VIF entry in instance network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap491684ab-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-57f3019e-2084-4076-ad98-ba32cb40ad0c req-b723e25a-aff5-449a-8310-b5089f6c2a16 service nova] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:48:54 user nova-compute[72863]: INFO nova.compute.claims [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Claim successful on node user
Aug 15 13:48:54 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:48:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.policy [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d0fa24067624373af89a9d02feaeb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa13aabad2104ae08ef0aea27447ad10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:48:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Creating image(s)
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "/opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "/opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk 1073741824" returned: 0 in 0.048s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:48:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Successfully created port: 04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Cannot resize image /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'migration_context' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Ensure instance console log exists: /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Successfully updated port: 04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107321.9228647, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:48:56 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Stopped (Lifecycle Event)
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e58b00cc-ceb9-4f9a-9951-875bdb008938 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-changed-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.compute.manager [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Refreshing instance network info cache due to event network-changed-04571696-b560-4f2b-b747-25f3cf7610ec. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG nova.network.neutron [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Refreshing network info cache for port 04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:48:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.neutron [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bf3ad559-c02c-4e8e-bd6f-ed4c2777c7b4 req-1f52f5c2-618b-42ce-88da-0c1f5f0343d5 service nova] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance network_info: |[{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Start _get_guest_xml network_info=[{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:48:57 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:48:57 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-705461718',display_name='tempest-TestServerVolumeAttachmentScenario-server-705461718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-705461718',id=49,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lSP9PbrypX7yMkTV/RgbPz8meXV5+eQe5xUsa3sRChe2eJo0XAMawD/a6xWY++J5LDkc7RbMca9ZwHFU1BaMnr1BHwkBpWW7WemPdQspxKObjMd9xb0qScdve4+hYgw==',key_name='tempest-keypair-290457420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa13aabad2104ae08ef0aea27447ad10',ramdisk_id='',reservation_id='r-4hpmodos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-413459882',owner_user_name='tempest-TestServerVolumeAttachmentScenario-413459882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d0fa24067624373af89a9d02feaeb8c',uuid=0b633526-ab32-42dd-91f5-2dca9655bfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converting VIF {"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:48:57 user nova-compute[72863]:   <uuid>0b633526-ab32-42dd-91f5-2dca9655bfa3</uuid>
Aug 15 13:48:57 user nova-compute[72863]:   <name>instance-00000031</name>
Aug 15 13:48:57 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:48:57 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:48:57 user nova-compute[72863]:   <metadata>
Aug 15 13:48:57 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:48:57 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-705461718</nova:name>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:48:57</nova:creationTime>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:48:57 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:48:57 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:owner>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:user uuid="5d0fa24067624373af89a9d02feaeb8c">tempest-TestServerVolumeAttachmentScenario-413459882-project-member</nova:user>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:project uuid="aa13aabad2104ae08ef0aea27447ad10">tempest-TestServerVolumeAttachmentScenario-413459882</nova:project>
Aug 15 13:48:57 user nova-compute[72863]:       </nova:owner>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:48:57 user nova-compute[72863]:       <nova:ports>
Aug 15 13:48:57 user nova-compute[72863]:         <nova:port uuid="04571696-b560-4f2b-b747-25f3cf7610ec">
Aug 15 13:48:57 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:48:57 user nova-compute[72863]:         </nova:port>
Aug 15 13:48:57 user nova-compute[72863]:       </nova:ports>
Aug 15 13:48:57 user nova-compute[72863]:     </nova:instance>
Aug 15 13:48:57 user nova-compute[72863]:   </metadata>
Aug 15 13:48:57 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:48:57 user nova-compute[72863]:     <system>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="serial">0b633526-ab32-42dd-91f5-2dca9655bfa3</entry>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="uuid">0b633526-ab32-42dd-91f5-2dca9655bfa3</entry>
Aug 15 13:48:57 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:48:57 user nova-compute[72863]:     </system>
Aug 15 13:48:57 user nova-compute[72863]:   </sysinfo>
Aug 15 13:48:57 user nova-compute[72863]:   <os>
Aug 15 13:48:57 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:48:57 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:48:57 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:48:57 user nova-compute[72863]:   </os>
Aug 15 13:48:57 user nova-compute[72863]:   <features>
Aug 15 13:48:57 user nova-compute[72863]:     <acpi/>
Aug 15 13:48:57 user nova-compute[72863]:     <apic/>
Aug 15 13:48:57 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:48:57 user nova-compute[72863]:   </features>
Aug 15 13:48:57 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:48:57 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:48:57 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:48:57 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:48:57 user nova-compute[72863]:   </clock>
Aug 15 13:48:57 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:48:57 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:48:57 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:48:57 user nova-compute[72863]:   </cpu>
Aug 15 13:48:57 user nova-compute[72863]:   <devices>
Aug 15 13:48:57 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:48:57 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:48:57 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk"/>
Aug 15 13:48:57 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:48:57 user nova-compute[72863]:     </disk>
Aug 15 13:48:57 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:48:57 user nova-compute[72863]:       <mac address="fa:16:3e:b5:56:72"/>
Aug 15 13:48:57 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:48:57 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:48:57 user nova-compute[72863]:       <target dev="tap04571696-b5"/>
Aug 15 13:48:57 user nova-compute[72863]:     </interface>
Aug 15 13:48:57 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:48:57 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/console.log" append="off"/>
Aug 15 13:48:57 user nova-compute[72863]:     </serial>
Aug 15 13:48:57 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:48:57 user nova-compute[72863]:     <video>
Aug 15 13:48:57 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:48:57 user nova-compute[72863]:     </video>
Aug 15 13:48:57 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:48:57 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:48:57 user nova-compute[72863]:     </rng>
Aug 15 13:48:57 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:48:57 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:48:57 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:48:57 user nova-compute[72863]:     </memballoon>
Aug 15 13:48:57 user nova-compute[72863]:   </devices>
Aug 15 13:48:57 user nova-compute[72863]: </domain>
Aug 15 13:48:57 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-705461718',display_name='tempest-TestServerVolumeAttachmentScenario-server-705461718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-705461718',id=49,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lSP9PbrypX7yMkTV/RgbPz8meXV5+eQe5xUsa3sRChe2eJo0XAMawD/a6xWY++J5LDkc7RbMca9ZwHFU1BaMnr1BHwkBpWW7WemPdQspxKObjMd9xb0qScdve4+hYgw==',key_name='tempest-keypair-290457420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa13aabad2104ae08ef0aea27447ad10',ramdisk_id='',reservation_id='r-4hpmodos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-413459882',owner_user_name='tempest-TestServerVolumeAttachmentScenario-413459882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d0fa24067624373af89a9d02feaeb8c',uuid=0b633526-ab32-42dd-91f5-2dca9655bfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converting VIF {"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG os_vif [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04571696-b5, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04571696-b5, col_values=(('external_ids', {'iface-id': '04571696-b560-4f2b-b747-25f3cf7610ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:56:72', 'vm-uuid': '0b633526-ab32-42dd-91f5-2dca9655bfa3'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:57 user nova-compute[72863]: INFO os_vif [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5')
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:48:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No VIF found with MAC fa:16:3e:b5:56:72, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:48:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] No waiting events found dispatching network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:48:59 user nova-compute[72863]: WARNING nova.compute.manager [req-f4be1e0d-0ce1-4ab8-8d89-c6013f9aea85 req-32fc69a2-ec43-4a82-899d-b48c3fcf991e service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received unexpected event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec for instance with vm_state building and task_state spawning.
Aug 15 13:48:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_power_states {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:48:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing instance network info cache due to event network-changed-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] Acquiring lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] Acquired lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG nova.network.neutron [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Refreshing network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:00 user nova-compute[72863]: INFO nova.compute.manager [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Terminating instance
Aug 15 13:49:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107341.1850498, 0b633526-ab32-42dd-91f5-2dca9655bfa3 => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] VM Resumed (Lifecycle Event)
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance spawned successfully.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107341.1863897, 0b633526-ab32-42dd-91f5-2dca9655bfa3 => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] VM Started (Lifecycle Event)
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] No waiting events found dispatching network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:49:01 user nova-compute[72863]: WARNING nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received unexpected event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec for instance with vm_state building and task_state spawning.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-1e27a7d6-19ec-4230-b8ae-a980f93d5420 req-97567cd2-a96e-447a-9225-1356a0dcf9c3 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-unplugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Took 6.69 seconds to build instance.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-50e6e9f4-4cee-4544-b08e-c9c7b4075296 tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.801s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.766s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updated VIF entry in instance network info cache for port cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.network.neutron [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [{"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-aa474bd3-9383-4af2-adfa-2113874c2064 req-4bbeacbe-b1e7-403c-88c0-ec18b518174b service nova] Releasing lock "refresh_cache-48312188-1fe8-4d83-b619-21dc0e8e98be" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Instance destroyed successfully.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lazy-loading 'resources' on Instance uuid 48312188-1fe8-4d83-b619-21dc0e8e98be {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1126009146',display_name='tempest-TestShelveInstance-server-1126009146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1126009146',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUdOndPGjtkpy3AvPM2Qfj5GJ89Ka936KRsYI+Cp1/a+eX+x29hK//YCeCwEIGLeT5+9ifITnEksniwSBMuvLRSwT8rCdCMSxQkfVfUQnDrTT7VegCICLJA/n1bDFaXbA==',key_name='tempest-TestShelveInstance-838633721',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e0e885268a846f29fc247590d7c890e',ramdisk_id='',reservation_id='r-lj1jc7es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-144861718',owner_user_name='tempest-TestShelveInstance-144861718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:47:27Z,user_data=None,user_id='9ad4bb906fef4b7baa9d97acdc711574',uuid=48312188-1fe8-4d83-b619-21dc0e8e98be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converting VIF {"id": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "address": "fa:16:3e:fc:f4:db", "network": {"id": "08bad42c-9147-4207-b7c4-a2f668a94b21", "bridge": "br-int", "label": "tempest-TestShelveInstance-517744088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0e885268a846f29fc247590d7c890e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf26e8f0-5a", "ovs_interfaceid": "cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_vif [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf26e8f0-5a, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:49:01 user nova-compute[72863]: INFO os_vif [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f4:db,bridge_name='br-int',has_traffic_filtering=True,id=cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d,network=Network(08bad42c-9147-4207-b7c4-a2f668a94b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf26e8f0-5a')
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oILHdhkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:49:01 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecef81a-7bc6-49e5-bc4a-eb4b6b7e3c3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240b04a-0c8e-40c0-bac0-219be594fd35]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:49:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a (non-flash)
Aug 15 13:49:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc59fb51-9a73-40e2-8bd0-06e1f80bd519]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c111da-f247-44ef-a742-b5c5708d0cf4]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ed757-7af1-4ea6-a93b-b751e5de960a]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23dcefd-babc-4d77-b1e9-656ea6db09d0]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO36cd4483-ff39a0f1a778a675', '/dev/disk/by-id/scsi-26666333961306631', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_36cd4483') {{(pid=84064) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b6530-bf2b-4b1e-b3d6-c86ff5db27a7]: (4, None) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ee3a74-3667-48d3-94dd-dd041b671fb8]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d92b0-8362-4bf4-a2a5-34b5d16c9740]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260]
Aug 15 13:49:01 user nova-compute[72863]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a, portal: 172.16.0.220,3260] successful.
Aug 15 13:49:01 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8311de-bf99-4408-8d50-880ca640621a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ad128-ed23-4d71-b23d-f247d309c527]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] <== disconnect_volume: return (317ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deleting instance files /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be_del
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deletion of /opt/stack/data/nova/instances/48312188-1fe8-4d83-b619-21dc0e8e98be_del complete
Aug 15 13:49:01 user nova-compute[72863]: INFO nova.compute.manager [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 13:49:01 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:49:01 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:49:02 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:49:02 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Took 0.59 seconds to deallocate network for instance.
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] Acquiring lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] No waiting events found dispatching network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:49:03 user nova-compute[72863]: WARNING nova.compute.manager [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received unexpected event network-vif-plugged-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d for instance with vm_state active and task_state deleting.
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-cd226bc4-a5bb-4a6f-a102-4e34b8234d3b req-bb0e05a3-7dae-4a49-afbb-7a7688cdea69 service nova] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Received event network-vif-deleted-cf26e8f0-5a0d-4a1a-8b1b-762986cdf71d {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:03 user nova-compute[72863]: INFO nova.compute.manager [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Took 0.92 seconds to detach 1 volumes for instance.
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Deleting volume: ee8311de-bf99-4408-8d50-880ca640621a {{(pid=72863) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:03 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Deleted allocations for instance 48312188-1fe8-4d83-b619-21dc0e8e98be
Aug 15 13:49:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e9a93d5d-b4e3-4386-accb-fe90d378a641 tempest-TestShelveInstance-144861718 tempest-TestShelveInstance-144861718-project-member] Lock "48312188-1fe8-4d83-b619-21dc0e8e98be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.159s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:16 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107341.5221026, 48312188-1fe8-4d83-b619-21dc0e8e98be => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:49:16 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] VM Stopped (Lifecycle Event)
Aug 15 13:49:16 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5445da6d-835a-4ce4-9566-55506bc5a505 None None] [instance: 48312188-1fe8-4d83-b619-21dc0e8e98be] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:49:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing instance network info cache due to event network-changed-a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] Acquiring lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] Acquired lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Refreshing network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:25 user nova-compute[72863]: INFO nova.compute.manager [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Terminating instance
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updated VIF entry in instance network info cache for port a4431105-80e4-4812-b7a7-0b8cf4d56fad. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.neutron [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [{"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-da3e02ef-a93c-45d5-b16f-b8699683ab72 req-59404311-86fd-433c-99a4-30dee935b6e9 service nova] Releasing lock "refresh_cache-9008be77-bd34-4015-94de-0c715cfc8e5d" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:49:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Instance destroyed successfully.
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lazy-loading 'resources' on Instance uuid 9008be77-bd34-4015-94de-0c715cfc8e5d {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-619756843',display_name='tempest-TestStampPattern-server-619756843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619756843',id=42,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJGVuW8GcNPnPcdisiDfB/HxsbQAm52io0w3orHnQ4+GqNvGp2u+DhI0PIZiJLuA6FiGRt3n9mAo0yv3LJO04ILYr7lEzwPeFP78JDOslhcxwYuT4vX+OZQeBxv7LzwSw==',key_name='tempest-TestStampPattern-475335408',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:42:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f13fc66607d40eaa9e8a3249110a8c6',ramdisk_id='',reservation_id='r-83fi8jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1256330650',owner_user_name='tempest-TestStampPattern-1256330650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:45:11Z,user_data=None,user_id='2ea18fce6a0b49e5b5aa04ac0f207495',uuid=9008be77-bd34-4015-94de-0c715cfc8e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converting VIF {"id": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "address": "fa:16:3e:1e:c3:02", "network": {"id": "f2a2fce9-5dc9-42e5-9868-e98eaad391c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1798707756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f13fc66607d40eaa9e8a3249110a8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4431105-80", "ovs_interfaceid": "a4431105-80e4-4812-b7a7-0b8cf4d56fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG os_vif [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4431105-80, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:49:25 user nova-compute[72863]: INFO os_vif [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c3:02,bridge_name='br-int',has_traffic_filtering=True,id=a4431105-80e4-4812-b7a7-0b8cf4d56fad,network=Network(f2a2fce9-5dc9-42e5-9868-e98eaad391c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4431105-80')
Aug 15 13:49:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Deleting instance files /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d_del
Aug 15 13:49:25 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Deletion of /opt/stack/data/nova/instances/9008be77-bd34-4015-94de-0c715cfc8e5d_del complete
Aug 15 13:49:25 user nova-compute[72863]: INFO nova.compute.manager [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 15 13:49:25 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:49:25 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:49:26 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Took 0.52 seconds to deallocate network for instance.
Aug 15 13:49:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-9dcac3d2-2574-4cfa-a0dd-a65133f06235 req-53a3f383-d75e-4428-8f0f-f606c698afdd service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-vif-deleted-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:49:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:26 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Deleted allocations for instance 9008be77-bd34-4015-94de-0c715cfc8e5d
Aug 15 13:49:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a8a7e121-ac9a-4ca9-b678-942a1125cbdd tempest-TestStampPattern-1256330650 tempest-TestStampPattern-1256330650-project-member] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.668s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-vif-unplugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] No waiting events found dispatching network-vif-unplugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:49:27 user nova-compute[72863]: WARNING nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received unexpected event network-vif-unplugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad for instance with vm_state deleted and task_state None.
Aug 15 13:49:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Acquiring lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] Lock "9008be77-bd34-4015-94de-0c715cfc8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] No waiting events found dispatching network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:49:27 user nova-compute[72863]: WARNING nova.compute.manager [req-bc228c82-6ab9-4179-bbd2-987949387ff4 req-84f626c2-9423-46ad-975b-2e28389af852 service nova] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Received unexpected event network-vif-plugged-a4431105-80e4-4812-b7a7-0b8cf4d56fad for instance with vm_state deleted and task_state None.
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:30 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:49:30 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:49:30 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.506622314453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:49:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:49:31 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:49:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:38 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:49:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107365.8394163, 9008be77-bd34-4015-94de-0c715cfc8e5d => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:49:40 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] VM Stopped (Lifecycle Event)
Aug 15 13:49:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cfd3e772-3c42-41cc-9a57-89f6ebdce45d None None] [instance: 9008be77-bd34-4015-94de-0c715cfc8e5d] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:49:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:49:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:49:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:49:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:49:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:49:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:50:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:32 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:33 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=25.50464630126953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:34 user nova-compute[72863]: INFO nova.compute.manager [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Unshelving
Aug 15 13:50:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_requests' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'numa_topology' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:50:34 user nova-compute[72863]: INFO nova.compute.claims [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Claim successful on node user
Aug 15 13:50:34 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:50:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:34 user nova-compute[72863]: INFO nova.network.neutron [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating port 491684ab-fe8a-441f-ad0e-860b53b5cb13 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.compute.manager [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing instance network info cache due to event network-changed-491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.network.neutron [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:50:35 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Creating image(s)
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG nova.network.neutron [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Refreshing network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "596a88eea11c043f009889ce87bbad05e792cc47" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "596a88eea11c043f009889ce87bbad05e792cc47" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG nova.virt.images [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] 04bf2123-07af-4ffb-aecc-a25e464ed629 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.part /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.part /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.converted" returned: 0 in 0.415s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updated VIF entry in instance network info cache for port 491684ab-fe8a-441f-ad0e-860b53b5cb13. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG nova.network.neutron [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-99a2459d-f509-482e-9626-75fe15da18b4 req-3a4d3b76-7b0e-457f-9184-1944368364b2 service nova] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "596a88eea11c043f009889ce87bbad05e792cc47" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.954s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "596a88eea11c043f009889ce87bbad05e792cc47" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "596a88eea11c043f009889ce87bbad05e792cc47" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47,backing_fmt=raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47,backing_fmt=raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk 1073741824" returned: 0 in 0.051s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "596a88eea11c043f009889ce87bbad05e792cc47" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 --force-share --output=json" returned: 0 in 0.275s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'migration_context' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:38 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Rebasing disk image.
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 -F raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 -F raw /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk" returned: 0 in 2.297s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Ensure instance console log exists: /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start _get_guest_xml network_info=[{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='646c64aa383e5348b9b0af1d37f3b232',container_format='bare',created_at=2023-08-15T13:48:41Z,direct_url=<?>,disk_format='qcow2',id=04bf2123-07af-4ffb-aecc-a25e464ed629,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-375961415-shelved',owner='2cc9a115e03e455bb340a4b23376c4c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T13:48:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:50:40 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:40 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='646c64aa383e5348b9b0af1d37f3b232',container_format='bare',created_at=2023-08-15T13:48:41Z,direct_url=<?>,disk_format='qcow2',id=04bf2123-07af-4ffb-aecc-a25e464ed629,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-375961415-shelved',owner='2cc9a115e03e455bb340a4b23376c4c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T13:48:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='04bf2123-07af-4ffb-aecc-a25e464ed629',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2095236787',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:48:45.069131',shelved_host='user',shelved_image_id='04bf2123-07af-4ffb-aecc-a25e464ed629'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.objects.instance [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'pci_devices' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:50:41 user nova-compute[72863]:   <uuid>770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</uuid>
Aug 15 13:50:41 user nova-compute[72863]:   <name>instance-00000030</name>
Aug 15 13:50:41 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:50:41 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:50:41 user nova-compute[72863]:   <metadata>
Aug 15 13:50:41 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:50:41 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-375961415</nova:name>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:50:40</nova:creationTime>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:50:41 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:50:41 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:owner>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:user uuid="68d851d4db5542b889871f7300ad5158">tempest-AttachVolumeShelveTestJSON-69904858-project-member</nova:user>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:project uuid="2cc9a115e03e455bb340a4b23376c4c5">tempest-AttachVolumeShelveTestJSON-69904858</nova:project>
Aug 15 13:50:41 user nova-compute[72863]:       </nova:owner>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:root type="image" uuid="04bf2123-07af-4ffb-aecc-a25e464ed629"/>
Aug 15 13:50:41 user nova-compute[72863]:       <nova:ports>
Aug 15 13:50:41 user nova-compute[72863]:         <nova:port uuid="491684ab-fe8a-441f-ad0e-860b53b5cb13">
Aug 15 13:50:41 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 13:50:41 user nova-compute[72863]:         </nova:port>
Aug 15 13:50:41 user nova-compute[72863]:       </nova:ports>
Aug 15 13:50:41 user nova-compute[72863]:     </nova:instance>
Aug 15 13:50:41 user nova-compute[72863]:   </metadata>
Aug 15 13:50:41 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:50:41 user nova-compute[72863]:     <system>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="serial">770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</entry>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="uuid">770f02d7-038d-4bb6-a4ce-4c1d50d88b3b</entry>
Aug 15 13:50:41 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:50:41 user nova-compute[72863]:     </system>
Aug 15 13:50:41 user nova-compute[72863]:   </sysinfo>
Aug 15 13:50:41 user nova-compute[72863]:   <os>
Aug 15 13:50:41 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:50:41 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:50:41 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:50:41 user nova-compute[72863]:   </os>
Aug 15 13:50:41 user nova-compute[72863]:   <features>
Aug 15 13:50:41 user nova-compute[72863]:     <acpi/>
Aug 15 13:50:41 user nova-compute[72863]:     <apic/>
Aug 15 13:50:41 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:50:41 user nova-compute[72863]:   </features>
Aug 15 13:50:41 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:50:41 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:50:41 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:50:41 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:50:41 user nova-compute[72863]:   </clock>
Aug 15 13:50:41 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:50:41 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:50:41 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:50:41 user nova-compute[72863]:   </cpu>
Aug 15 13:50:41 user nova-compute[72863]:   <devices>
Aug 15 13:50:41 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:50:41 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:50:41 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk"/>
Aug 15 13:50:41 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:50:41 user nova-compute[72863]:     </disk>
Aug 15 13:50:41 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:50:41 user nova-compute[72863]:       <mac address="fa:16:3e:44:0f:59"/>
Aug 15 13:50:41 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:50:41 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:50:41 user nova-compute[72863]:       <target dev="tap491684ab-fe"/>
Aug 15 13:50:41 user nova-compute[72863]:     </interface>
Aug 15 13:50:41 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:50:41 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/console.log" append="off"/>
Aug 15 13:50:41 user nova-compute[72863]:     </serial>
Aug 15 13:50:41 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:50:41 user nova-compute[72863]:     <video>
Aug 15 13:50:41 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:50:41 user nova-compute[72863]:     </video>
Aug 15 13:50:41 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:50:41 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:50:41 user nova-compute[72863]:     </rng>
Aug 15 13:50:41 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:50:41 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:50:41 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:50:41 user nova-compute[72863]:     </memballoon>
Aug 15 13:50:41 user nova-compute[72863]:   </devices>
Aug 15 13:50:41 user nova-compute[72863]: </domain>
Aug 15 13:50:41 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='04bf2123-07af-4ffb-aecc-a25e464ed629',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2095236787',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member',shelved_at='2023-08-15T13:48:45.069131',shelved_host='user',shelved_image_id='04bf2123-07af-4ffb-aecc-a25e464ed629'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG os_vif [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491684ab-fe, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap491684ab-fe, col_values=(('external_ids', {'iface-id': '491684ab-fe8a-441f-ad0e-860b53b5cb13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:0f:59', 'vm-uuid': '770f02d7-038d-4bb6-a4ce-4c1d50d88b3b'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:41 user nova-compute[72863]: INFO os_vif [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe')
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] No VIF found with MAC fa:16:3e:44:0f:59, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:50:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [{"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:43 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107444.664011, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:50:44 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Resumed (Lifecycle Event)
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:50:44 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance spawned successfully.
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:50:44 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107444.6673815, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:50:44 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Started (Lifecycle Event)
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:50:44 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:50:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-d1edc240-8f7f-46ab-a95b-7fe05675691d tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.731s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-changed-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG nova.compute.manager [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Refreshing instance network info cache due to event network-changed-04571696-b560-4f2b-b747-25f3cf7610ec. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:46 user nova-compute[72863]: DEBUG nova.network.neutron [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Refreshing network info cache for port 04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updated VIF entry in instance network info cache for port 04571696-b560-4f2b-b747-25f3cf7610ec. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.network.neutron [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ee732d08-ed08-4efb-a114-2acf3bd26187 req-e18bc817-6bf6-4b5e-b18d-0c1e2788f822 service nova] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.006s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:50:47 user nova-compute[72863]: INFO nova.compute.claims [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Claim successful on node user
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:47 user nova-compute[72863]: INFO nova.compute.manager [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attaching volume e137987c-f8a9-4f7b-a73e-9a188d362ecc to /dev/vdb
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.utils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b63e50b-1a4d-4969-8adf-f2ace048fe42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2652a550-e8f1-440d-9a76-6816042bc468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267bb4c-b8af-44d1-a92f-205d990f2bba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ecc74-1200-48aa-a2b3-ff98fc1e75b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.policy [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25ca34c4a7eb4e93b46acb8a9a7d709b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679342ef450443fe97674289f5b2098d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:50:47 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1051425-ab39-47a3-8f3e-8d6f76c90d31]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG os_brick.utils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating existing volume attachment record: 9c48343b-162b-49de-bfb5-35ca9f803aff {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:50:47 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Creating image(s)
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "/opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "/opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "/opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.200s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14,backing_fmt=raw /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk 1073741824" returned: 0 in 0.061s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "970e8b98e32b4b0485b665aec45e02ad7ef35c14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14 --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Successfully created port: d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.compute.manager [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:50:48 user nova-compute[72863]: WARNING nova.compute.manager [req-d025df10-ba55-4a0b-94f1-ff2f505ca557 req-4201f316-2204-4c63-bb7c-6a674ab540bf service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state active and task_state None.
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Cannot resize image /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'migration_context' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Ensure instance console log exists: /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Successfully updated port: d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-changed-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.compute.manager [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Refreshing instance network info cache due to event network-changed-d5a5f301-807a-49eb-9189-b5de176a7803. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Instance network_info: |[{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.network.neutron [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Refreshing network info cache for port d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:50:49 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Start _get_guest_xml network_info=[{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '40a3270d-656b-4d7d-8be8-25ab1ae5fd35'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:50:50 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:50 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:18:40Z,direct_url=<?>,disk_format='qcow2',id=40a3270d-656b-4d7d-8be8-25ab1ae5fd35,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='34ec976ddcb840c4b421dc37e82bc3e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:18:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-940682880',display_name='tempest-SnapshotDataIntegrityTests-server-940682880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-940682880',id=50,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSmu2acvgPB7k2V66amyonWfo+JKZr1eR8hKAKNonPYOG9/L7JQ8lR7S9IHalBrOruAcSvdbU6foP5WF6ZZtA9cj37NtsLx6s+mWDP5VQ7D9KynD+dFt6jm2+82Ao0Sfw==',key_name='tempest-keypair-893155915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679342ef450443fe97674289f5b2098d',ramdisk_id='',reservation_id='r-pt8tgze6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-650013113',owner_user_name='tempest-SnapshotDataIntegrityTests-650013113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25ca34c4a7eb4e93b46acb8a9a7d709b',uuid=fac848d8-4f39-4963-8930-6c13cd899bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converting VIF {"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.objects.instance [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'pci_devices' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:50:50 user nova-compute[72863]:   <uuid>fac848d8-4f39-4963-8930-6c13cd899bdb</uuid>
Aug 15 13:50:50 user nova-compute[72863]:   <name>instance-00000032</name>
Aug 15 13:50:50 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:50:50 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:50:50 user nova-compute[72863]:   <metadata>
Aug 15 13:50:50 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:50:50 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-940682880</nova:name>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:50:50</nova:creationTime>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:50:50 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:50:50 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:owner>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:user uuid="25ca34c4a7eb4e93b46acb8a9a7d709b">tempest-SnapshotDataIntegrityTests-650013113-project-member</nova:user>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:project uuid="679342ef450443fe97674289f5b2098d">tempest-SnapshotDataIntegrityTests-650013113</nova:project>
Aug 15 13:50:50 user nova-compute[72863]:       </nova:owner>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:root type="image" uuid="40a3270d-656b-4d7d-8be8-25ab1ae5fd35"/>
Aug 15 13:50:50 user nova-compute[72863]:       <nova:ports>
Aug 15 13:50:50 user nova-compute[72863]:         <nova:port uuid="d5a5f301-807a-49eb-9189-b5de176a7803">
Aug 15 13:50:50 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 13:50:50 user nova-compute[72863]:         </nova:port>
Aug 15 13:50:50 user nova-compute[72863]:       </nova:ports>
Aug 15 13:50:50 user nova-compute[72863]:     </nova:instance>
Aug 15 13:50:50 user nova-compute[72863]:   </metadata>
Aug 15 13:50:50 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:50:50 user nova-compute[72863]:     <system>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="serial">fac848d8-4f39-4963-8930-6c13cd899bdb</entry>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="uuid">fac848d8-4f39-4963-8930-6c13cd899bdb</entry>
Aug 15 13:50:50 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:50:50 user nova-compute[72863]:     </system>
Aug 15 13:50:50 user nova-compute[72863]:   </sysinfo>
Aug 15 13:50:50 user nova-compute[72863]:   <os>
Aug 15 13:50:50 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:50:50 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:50:50 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:50:50 user nova-compute[72863]:   </os>
Aug 15 13:50:50 user nova-compute[72863]:   <features>
Aug 15 13:50:50 user nova-compute[72863]:     <acpi/>
Aug 15 13:50:50 user nova-compute[72863]:     <apic/>
Aug 15 13:50:50 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:50:50 user nova-compute[72863]:   </features>
Aug 15 13:50:50 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:50:50 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:50:50 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:50:50 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:50:50 user nova-compute[72863]:   </clock>
Aug 15 13:50:50 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:50:50 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:50:50 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:50:50 user nova-compute[72863]:   </cpu>
Aug 15 13:50:50 user nova-compute[72863]:   <devices>
Aug 15 13:50:50 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:50:50 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:50:50 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk"/>
Aug 15 13:50:50 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:50:50 user nova-compute[72863]:     </disk>
Aug 15 13:50:50 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:50:50 user nova-compute[72863]:       <mac address="fa:16:3e:3c:38:de"/>
Aug 15 13:50:50 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:50:50 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:50:50 user nova-compute[72863]:       <target dev="tapd5a5f301-80"/>
Aug 15 13:50:50 user nova-compute[72863]:     </interface>
Aug 15 13:50:50 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:50:50 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/console.log" append="off"/>
Aug 15 13:50:50 user nova-compute[72863]:     </serial>
Aug 15 13:50:50 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:50:50 user nova-compute[72863]:     <video>
Aug 15 13:50:50 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:50:50 user nova-compute[72863]:     </video>
Aug 15 13:50:50 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:50:50 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:50:50 user nova-compute[72863]:     </rng>
Aug 15 13:50:50 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:50:50 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:50:50 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:50:50 user nova-compute[72863]:     </memballoon>
Aug 15 13:50:50 user nova-compute[72863]:   </devices>
Aug 15 13:50:50 user nova-compute[72863]: </domain>
Aug 15 13:50:50 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-940682880',display_name='tempest-SnapshotDataIntegrityTests-server-940682880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-940682880',id=50,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSmu2acvgPB7k2V66amyonWfo+JKZr1eR8hKAKNonPYOG9/L7JQ8lR7S9IHalBrOruAcSvdbU6foP5WF6ZZtA9cj37NtsLx6s+mWDP5VQ7D9KynD+dFt6jm2+82Ao0Sfw==',key_name='tempest-keypair-893155915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679342ef450443fe97674289f5b2098d',ramdisk_id='',reservation_id='r-pt8tgze6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-650013113',owner_user_name='tempest-SnapshotDataIntegrityTests-650013113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25ca34c4a7eb4e93b46acb8a9a7d709b',uuid=fac848d8-4f39-4963-8930-6c13cd899bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converting VIF {"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG os_vif [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5a5f301-80, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5a5f301-80, col_values=(('external_ids', {'iface-id': 'd5a5f301-807a-49eb-9189-b5de176a7803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:38:de', 'vm-uuid': 'fac848d8-4f39-4963-8930-6c13cd899bdb'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:50 user nova-compute[72863]: INFO os_vif [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80')
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No VIF found with MAC fa:16:3e:3c:38:de, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.neutron [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updated VIF entry in instance network info cache for port d5a5f301-807a-49eb-9189-b5de176a7803. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.network.neutron [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-bbe028fe-869f-401d-9b54-d49c291bcda2 req-3fffa7f2-e15a-4e6b-bac1-0a2817903d34 service nova] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:50 user nova-compute[72863]: DEBUG nova.compute.manager [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:50:50 user nova-compute[72863]: WARNING nova.compute.manager [req-47fadbf5-2df9-4fe9-bd6d-18038fe61c59 req-7388bf35-bd54-442b-b518-9d3cba32e25d service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state active and task_state None.
Aug 15 13:50:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG nova.compute.manager [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] No waiting events found dispatching network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:50:52 user nova-compute[72863]: WARNING nova.compute.manager [req-05e011f7-64c5-427c-afaa-891ceddc0437 req-b8bddbe0-5fa2-4ed6-9c41-a393689ee81f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received unexpected event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 for instance with vm_state building and task_state spawning.
Aug 15 13:50:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107453.684083, fac848d8-4f39-4963-8930-6c13cd899bdb => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] VM Resumed (Lifecycle Event)
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Instance spawned successfully.
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107453.6888752, fac848d8-4f39-4963-8930-6c13cd899bdb => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] VM Started (Lifecycle Event)
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 15 13:50:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:50:53 user nova-compute[72863]: INFO nova.compute.manager [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Took 6.55 seconds to build instance.
Aug 15 13:50:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-e4e44d7e-1762-4b0e-8c2f-d2bf4172eefa tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:50:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:50:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:50:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:50:54 user nova-compute[72863]: DEBUG nova.compute.manager [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] No waiting events found dispatching network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:50:54 user nova-compute[72863]: WARNING nova.compute.manager [req-cdffbaea-879e-42a4-b36a-559f35717ec6 req-05762c00-2df8-4992-ba0b-6cb728db353f service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received unexpected event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 for instance with vm_state active and task_state None.
Aug 15 13:50:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxEWpvnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:50:56 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:50:56 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:50:56 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:50:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2531534-0725-436f-9426-5fb26e91f4ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:50:56 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd72ba7-4699-4f26-8d8b-657f9147bdde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc] added
Aug 15 13:50:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[45890e37-d094-491f-a668-2f7bc24a525c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbbf86-d17b-4cad-b2a6-491444cd90f7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxEWpvnm {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxEWpvnm" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08882f2a-c79f-453d-bd82-abf87c25cb80]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxEWpvnm'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[359006e2-cce9-448d-9138-693c927da3f7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ce77c-5282-4fc5-9041-24c393bf1f0c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:50:57 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:50:57 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:50:57 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:50:57 user nova-compute[72863]: 
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7b57b-6feb-4bfa-8f5a-aa3f7aa8c72a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260]
Aug 15 13:50:57 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260] successful.
Aug 15 13:50:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebab4ad-150c-40ba-80a6-5cb2b8ec6ab5]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6fefc-b86a-466f-b148-01f73f340527]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:50:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:50:57 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33d55f9-0d54-4665-a62b-4998cc78b2ac]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:50:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxEWpvnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23137363963656361', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137363963656361', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:50:58 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:50:58 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:50:58 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:50:58 user nova-compute[72863]:   <serial>e137987c-f8a9-4f7b-a73e-9a188d362ecc</serial>
Aug 15 13:50:58 user nova-compute[72863]: </disk>
Aug 15 13:50:58 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No VIF found with MAC fa:16:3e:b5:56:72, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:50:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ef00611-b56a-448a-9977-301c0b14b95e tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.275s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG nova.objects.instance [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:51:01 user nova-compute[72863]: INFO nova.compute.manager [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attaching volume 65b4cd99-274b-495f-83ad-9536c746991d to /dev/vdc
Aug 15 13:51:01 user nova-compute[72863]: DEBUG os_brick.utils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70e617-72cb-4776-9132-b18177274136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c3d1cc-9461-4ccc-95e0-70617c84ecb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5bb34c-7af8-4d83-9e47-4b29d8e4332c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[076b1245-b0b9-40bc-8ab5-aa6fd1df1e8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:51:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:51:02 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:51:02 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee960a0-4690-4e88-8812-23799a118cf1]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG os_brick.utils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:51:02 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating existing volume attachment record: d0cc1562-e499-4026-8164-a9390b3753b2 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:51:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzYXwMFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:51:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:51:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:51:11 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63f425-6fb6-42d6-90b7-ebf333bcd2c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:51:11 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b75563-c0f3-45d4-86c0-303bcba80397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d] added
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3361d-68a9-4523-a572-5783f9820c89]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ffe946-47a6-4463-9ce8-1a2803b8bb4c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzYXwMFJ {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzYXwMFJ" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967acbc-f5ef-4044-82c8-32e0fad8483f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzYXwMFJ'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec56ca0-e948-496d-b41c-2aea85c1442d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3087a-5a1b-44f0-97c2-36375390ea9c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c0c4d4-2c50-436c-b0b4-90adede4b1c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260]
Aug 15 13:51:11 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260] successful.
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda4e2b-d278-4ec0-af2a-463c2c2a289d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1bd49b-e92d-4d18-ba20-586a90ce4f1f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:11 user nova-compute[72863]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:11 user nova-compute[72863]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)
Aug 15 13:51:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc78e5-ed54-4779-bd15-455b0315a7f8]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:51:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzYXwMFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23764356362646538', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764356362646538', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:51:12 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:51:12 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:51:12 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:51:12 user nova-compute[72863]:   <serial>65b4cd99-274b-495f-83ad-9536c746991d</serial>
Aug 15 13:51:12 user nova-compute[72863]: </disk>
Aug 15 13:51:12 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] No VIF found with MAC fa:16:3e:b5:56:72, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:51:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-52119970-77b2-4020-a211-2dcc92b6f22b tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.155s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:51:13 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:51:13 user nova-compute[72863]: INFO nova.compute.manager [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Detaching volume 65b4cd99-274b-495f-83ad-9536c746991d
Aug 15 13:51:13 user nova-compute[72863]: INFO nova.virt.block_device [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attempting to driver detach volume 65b4cd99-274b-495f-83ad-9536c746991d from mountpoint /dev/vdc
Aug 15 13:51:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Attempting to detach device vdc from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:51:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:51:13 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:51:13 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:51:13 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:51:13 user nova-compute[72863]:   <serial>65b4cd99-274b-495f-83ad-9536c746991d</serial>
Aug 15 13:51:13 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:51:13 user nova-compute[72863]: </disk>
Aug 15 13:51:13 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:51:13 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully detached device vdc from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the persistent domain config.
Aug 15 13:51:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:51:13 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:51:13 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:51:13 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:51:13 user nova-compute[72863]:   <target dev="vdc" bus="virtio"/>
Aug 15 13:51:13 user nova-compute[72863]:   <serial>65b4cd99-274b-495f-83ad-9536c746991d</serial>
Aug 15 13:51:13 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 13:51:13 user nova-compute[72863]: </disk>
Aug 15 13:51:13 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107474.4239104, 0b633526-ab32-42dd-91f5-2dca9655bfa3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:51:14 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully detached device vdc from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the live domain config.
Aug 15 13:51:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzYXwMFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:51:14 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad0bed-8f68-475c-a64f-59a682b493f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5258f-48e6-4c79-bb43-427a81e6c326]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:14 user nova-compute[72863]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)
Aug 15 13:51:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:51:14 user nova-compute[72863]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d (non-flash)
Aug 15 13:51:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a4889-687a-4f10-bb3b-d52fbd0a187d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[016028d0-376a-4eb0-b772-6b1d0bf8fb33]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d56a4-b117-4ee7-83c9-f59fe17fa6ba]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47badc08-415c-42d4-a99b-4d9e93bfddf0]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf9b2c-a082-4125-9997-71f6f5113863]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ba7438-be25-4843-b97a-6dd39ef76187]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260]
Aug 15 13:51:14 user nova-compute[72863]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d, portal: 172.16.0.220,3260] successful.
Aug 15 13:51:14 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b4cd99-274b-495f-83ad-9536c746991d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46fcd16-64bf-4444-9a0b-165510be6ced]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== disconnect_volume: return (266ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:51:14 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:51:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:15 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:51:15 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb386db-dcec-4ad1-b3b3-9a054db7d0cb tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:51:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:51:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=25.43975067138672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:51:34 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:39 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:51:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:51:45 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:51:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:51:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:51:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:04 user nova-compute[72863]: INFO nova.compute.manager [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Detaching volume e137987c-f8a9-4f7b-a73e-9a188d362ecc
Aug 15 13:52:04 user nova-compute[72863]: INFO nova.virt.block_device [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Attempting to driver detach volume e137987c-f8a9-4f7b-a73e-9a188d362ecc from mountpoint /dev/vdb
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Attempting to detach device vdb from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:52:04 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:52:04 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:52:04 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:52:04 user nova-compute[72863]:   <serial>e137987c-f8a9-4f7b-a73e-9a188d362ecc</serial>
Aug 15 13:52:04 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:52:04 user nova-compute[72863]: </disk>
Aug 15 13:52:04 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:52:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully detached device vdb from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the persistent domain config.
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:52:04 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:52:04 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:52:04 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:52:04 user nova-compute[72863]:   <serial>e137987c-f8a9-4f7b-a73e-9a188d362ecc</serial>
Aug 15 13:52:04 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:52:04 user nova-compute[72863]: </disk>
Aug 15 13:52:04 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107524.845719, 0b633526-ab32-42dd-91f5-2dca9655bfa3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:52:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully detached device vdb from instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 from the live domain config.
Aug 15 13:52:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxEWpvnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:52:04 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de29d0f-3a62-4ba8-ab2c-3726b79e6726]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dac127-e4d2-465c-b356-d3ff5336d480]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:52:04 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc (non-flash)
Aug 15 13:52:04 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c2c28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ada46-beb4-4e99-93af-fe7b84fbecdf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10169361-7def-4173-beca-f9365d242ac0]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b75c5-ce4a-4a3e-814f-b551bf914f2c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:52:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae6553-3626-4a09-953a-8a44849764ca]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[56df035d-46df-4360-908c-2dedf69d4080]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fd72b-0cbe-4d75-8109-d1280bb9da0b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260]
Aug 15 13:52:05 user nova-compute[72863]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc, portal: 172.16.0.220,3260] successful.
Aug 15 13:52:05 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137987c-f8a9-4f7b-a73e-9a188d362ecc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97113c81-dfec-4dd5-8fab-7d8aa7f36029]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] <== disconnect_volume: return (244ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:06 user nova-compute[72863]: DEBUG nova.objects.instance [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'flavor' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-33feb6da-d958-4fb2-9997-427af09af89c tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:24 user nova-compute[72863]: INFO nova.compute.manager [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Terminating instance
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-4b02f796-593f-466c-8566-ad3bfb934b86 req-0b6a0e75-3df5-4bb6-9f66-22bbba9b1d85 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-unplugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Instance destroyed successfully.
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.objects.instance [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lazy-loading 'resources' on Instance uuid 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T13:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-375961415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-375961415',id=48,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhUCsfWkvuOdWh66EF/8BhTYwlZppWqIJAQPYxny5w4MKZ9Hthw8t1Tf4VAHHubrvYOTdxg9Q8mThRvF1iBtqQQR5P4s4tH5Rkxkp+JhPaEi2yFKb2N+IMcLTIMuvyczg==',key_name='tempest-keypair-2095236787',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cc9a115e03e455bb340a4b23376c4c5',ramdisk_id='',reservation_id='r-cghfbr44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-69904858',owner_user_name='tempest-AttachVolumeShelveTestJSON-69904858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d851d4db5542b889871f7300ad5158',uuid=770f02d7-038d-4bb6-a4ce-4c1d50d88b3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converting VIF {"id": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "address": "fa:16:3e:44:0f:59", "network": {"id": "9fb94d00-f071-4d08-a83f-9dcc824cdd2a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1476825101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9a115e03e455bb340a4b23376c4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491684ab-fe", "ovs_interfaceid": "491684ab-fe8a-441f-ad0e-860b53b5cb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG os_vif [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491684ab-fe, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:24 user nova-compute[72863]: INFO os_vif [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0f:59,bridge_name='br-int',has_traffic_filtering=True,id=491684ab-fe8a-441f-ad0e-860b53b5cb13,network=Network(9fb94d00-f071-4d08-a83f-9dcc824cdd2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491684ab-fe')
Aug 15 13:52:24 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Deleting instance files /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b_del
Aug 15 13:52:24 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Deletion of /opt/stack/data/nova/instances/770f02d7-038d-4bb6-a4ce-4c1d50d88b3b_del complete
Aug 15 13:52:24 user nova-compute[72863]: INFO nova.compute.manager [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 13:52:24 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:52:24 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:52:25 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Took 0.87 seconds to deallocate network for instance.
Aug 15 13:52:25 user nova-compute[72863]: DEBUG nova.compute.manager [req-8c87ef58-4615-4ff2-810a-ba9d58a25fcd req-e2b3b3a9-0111-4c9d-afb4-67b8e6d024f6 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-deleted-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:52:25 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:26 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Deleted allocations for instance 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b
Aug 15 13:52:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-5c2587e2-8259-4fe5-814a-d6c617abe4c6 tempest-AttachVolumeShelveTestJSON-69904858 tempest-AttachVolumeShelveTestJSON-69904858-project-member] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] Acquiring lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] Lock "770f02d7-038d-4bb6-a4ce-4c1d50d88b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:26 user nova-compute[72863]: DEBUG nova.compute.manager [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] No waiting events found dispatching network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:52:26 user nova-compute[72863]: WARNING nova.compute.manager [req-b00b2aa7-9ade-46a9-bb85-e981cec70f2a req-dcdf9d70-e0f7-410f-8ff5-0ad3df44d922 service nova] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Received unexpected event network-vif-plugged-491684ab-fe8a-441f-ad0e-860b53b5cb13 for instance with vm_state deleted and task_state None.
Aug 15 13:52:29 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:52:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8539MB free_disk=25.46683120727539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance 0b633526-ab32-42dd-91f5-2dca9655bfa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:34 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-changed-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG nova.compute.manager [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Refreshing instance network info cache due to event network-changed-d5a5f301-807a-49eb-9189-b5de176a7803. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Refreshing network info cache for port d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updated VIF entry in instance network info cache for port d5a5f301-807a-49eb-9189-b5de176a7803. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG nova.network.neutron [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:52:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-3734202c-7209-4a56-91b4-c7f55416b8d6 req-7c63b11b-adff-4285-8fa8-61b1f73a4498 service nova] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107544.7619827, 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:52:39 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] VM Stopped (Lifecycle Event)
Aug 15 13:52:39 user nova-compute[72863]: DEBUG nova.compute.manager [None req-a4c521e8-1963-4d24-b0d2-56a2adf5c9fe None None] [instance: 770f02d7-038d-4bb6-a4ce-4c1d50d88b3b] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG nova.objects.instance [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:43 user nova-compute[72863]: INFO nova.compute.manager [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attaching volume f6008886-dd7e-4482-8742-c14917b553d5 to /dev/vdb
Aug 15 13:52:43 user nova-compute[72863]: DEBUG os_brick.utils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[362145b6-2536-4c8e-9e8b-18593ead4853]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a79d2-0e03-4a12-a822-6f34c3e293a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05ec04-20ee-474e-b196-73487de26352]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d11c8a6-498c-40fd-a1c2-f572c0197478]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:52:44 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:52:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9a81a-b364-4c97-9b3a-0caeab1447a7]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG os_brick.utils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating existing volume attachment record: 9e868038-e4af-4fa7-9746-509872bb95a6 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:44 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [{"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-0b633526-ab32-42dd-91f5-2dca9655bfa3" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:52:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:52:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:50 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:54 user nova-compute[72863]: INFO nova.compute.manager [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Terminating instance
Aug 15 13:52:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:54 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-unplugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] No waiting events found dispatching network-vif-unplugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-4ec58f08-0c33-43ce-a1a9-1c4e2de4c869 req-703a1f5a-8bdf-4c8c-bba7-d8b70ab3f979 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-unplugged-04571696-b560-4f2b-b747-25f3cf7610ec for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:52:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Instance destroyed successfully.
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lazy-loading 'resources' on Instance uuid 0b633526-ab32-42dd-91f5-2dca9655bfa3 {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-705461718',display_name='tempest-TestServerVolumeAttachmentScenario-server-705461718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-705461718',id=49,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1lSP9PbrypX7yMkTV/RgbPz8meXV5+eQe5xUsa3sRChe2eJo0XAMawD/a6xWY++J5LDkc7RbMca9ZwHFU1BaMnr1BHwkBpWW7WemPdQspxKObjMd9xb0qScdve4+hYgw==',key_name='tempest-keypair-290457420',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:49:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa13aabad2104ae08ef0aea27447ad10',ramdisk_id='',reservation_id='r-4hpmodos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-413459882',owner_user_name='tempest-TestServerVolumeAttachmentScenario-413459882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d0fa24067624373af89a9d02feaeb8c',uuid=0b633526-ab32-42dd-91f5-2dca9655bfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converting VIF {"id": "04571696-b560-4f2b-b747-25f3cf7610ec", "address": "fa:16:3e:b5:56:72", "network": {"id": "fc51e5d0-84be-475d-bb4a-529827a5139a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1650739016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa13aabad2104ae08ef0aea27447ad10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04571696-b5", "ovs_interfaceid": "04571696-b560-4f2b-b747-25f3cf7610ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG os_vif [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04571696-b5, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:55 user nova-compute[72863]: INFO os_vif [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:56:72,bridge_name='br-int',has_traffic_filtering=True,id=04571696-b560-4f2b-b747-25f3cf7610ec,network=Network(fc51e5d0-84be-475d-bb4a-529827a5139a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04571696-b5')
Aug 15 13:52:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Deleting instance files /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3_del
Aug 15 13:52:55 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Deletion of /opt/stack/data/nova/instances/0b633526-ab32-42dd-91f5-2dca9655bfa3_del complete
Aug 15 13:52:55 user nova-compute[72863]: INFO nova.compute.manager [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 15 13:52:55 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:52:55 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:52:56 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Took 0.85 seconds to deallocate network for instance.
Aug 15 13:52:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:52:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:56 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Deleted allocations for instance 0b633526-ab32-42dd-91f5-2dca9655bfa3
Aug 15 13:52:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-0ee64903-3c67-4f4c-988a-07443a32b30f tempest-TestServerVolumeAttachmentScenario-413459882 tempest-TestServerVolumeAttachmentScenario-413459882-project-member] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] Acquiring lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:52:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:52:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] Lock "0b633526-ab32-42dd-91f5-2dca9655bfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:52:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] No waiting events found dispatching network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:52:57 user nova-compute[72863]: WARNING nova.compute.manager [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received unexpected event network-vif-plugged-04571696-b560-4f2b-b747-25f3cf7610ec for instance with vm_state deleted and task_state None.
Aug 15 13:52:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-95a680d1-929d-48af-addc-b6f4ffe7d305 req-cc485f1a-b3f8-4a98-9c41-72feb5974265 service nova] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Received event network-vif-deleted-04571696-b560-4f2b-b747-25f3cf7610ec {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZJBdybG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:52:58 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:52:58 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:52:58 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccfdb7c-2181-489e-9f53-eca02fd0fea7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:52:58 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75dbc60-a193-4460-9d6d-64691de29ddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5] added
Aug 15 13:52:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e618c36-4b38-42cc-a8f0-b7fc1df50c31]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09290a28-73e6-488e-b4d2-2e00680d62e6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZJBdybG {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZJBdybG" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aa6c61-e66e-4e74-b2c3-d1642f73688d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vZJBdybG'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55115252-431b-476d-aea0-a7e312020c9d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4204b457-6338-4d69-9e0d-8c335d8ffe5e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:52:58 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:52:58 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:52:58 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:52:58 user nova-compute[72863]: 
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ef539-a50b-4428-a422-a2468be4fc5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260]
Aug 15 13:52:58 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260] successful.
Aug 15 13:52:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d84526-6a69-48ae-8bae-113271ea9ce2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8cb4bb-b3ef-4191-82a7-e931c434ffc8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)
Aug 15 13:52:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)
Aug 15 13:52:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[095db0fc-228f-477c-9e99-e2fe67eeeacc]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:52:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZJBdybG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26337316466393734', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337316466393734', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:52:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:52:59 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:52:59 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:52:59 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:52:59 user nova-compute[72863]:   <serial>f6008886-dd7e-4482-8742-c14917b553d5</serial>
Aug 15 13:52:59 user nova-compute[72863]: </disk>
Aug 15 13:52:59 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:53:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:53:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:53:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No VIF found with MAC fa:16:3e:3c:38:de, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:53:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-eaff51bc-8f1c-4f27-93c4-c3a3a519145a tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.427s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:10 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107575.551371, 0b633526-ab32-42dd-91f5-2dca9655bfa3 => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:53:10 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] VM Stopped (Lifecycle Event)
Aug 15 13:53:10 user nova-compute[72863]: DEBUG nova.compute.manager [None req-8d6f42b2-3615-4f93-90d1-e59fe82b991e None None] [instance: 0b633526-ab32-42dd-91f5-2dca9655bfa3] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:53:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:53:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:33 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:53:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:53:34 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.484939575195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:53:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:36 user nova-compute[72863]: INFO nova.compute.manager [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Detaching volume f6008886-dd7e-4482-8742-c14917b553d5
Aug 15 13:53:36 user nova-compute[72863]: INFO nova.virt.block_device [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attempting to driver detach volume f6008886-dd7e-4482-8742-c14917b553d5 from mountpoint /dev/vdb
Aug 15 13:53:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Attempting to detach device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:53:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:53:36 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:53:36 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:53:36 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:53:36 user nova-compute[72863]:   <serial>f6008886-dd7e-4482-8742-c14917b553d5</serial>
Aug 15 13:53:36 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:53:36 user nova-compute[72863]: </disk>
Aug 15 13:53:36 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:53:36 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config.
Aug 15 13:53:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:53:36 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:53:36 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:53:36 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:53:36 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:53:36 user nova-compute[72863]:   <serial>f6008886-dd7e-4482-8742-c14917b553d5</serial>
Aug 15 13:53:36 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:53:36 user nova-compute[72863]: </disk>
Aug 15 13:53:36 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107617.1089242, fac848d8-4f39-4963-8930-6c13cd899bdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:53:37 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config.
Aug 15 13:53:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZJBdybG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:53:37 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c9c1e5-dadb-448b-be28-075320ad03af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad009b7-8bdf-43c5-bdf0-0ee1a1716f88]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)
Aug 15 13:53:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 (non-flash)
Aug 15 13:53:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c2c1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af98825-56fe-45b3-b5d1-e794a619a614]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ccef34-5c1c-4301-8734-6f788b365116]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c2b0e-61bc-4272-87af-f4a31f0a7815]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[958e6008-0e33-4d84-871e-65206e9afa04]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f4d73-f3fe-43f9-b268-360d8afa699e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66871c46-ffff-49cd-918a-0a78bc4dba4c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260]
Aug 15 13:53:37 user nova-compute[72863]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5, portal: 172.16.0.220,3260] successful.
Aug 15 13:53:37 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6008886-dd7e-4482-8742-c14917b553d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c8ec0-47ed-4f92-8b02-8aa439d0c894]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== disconnect_volume: return (279ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:53:37 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:53:38 user nova-compute[72863]: DEBUG nova.objects.instance [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:53:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-418c6539-7441-40eb-a3e4-faa5408a02be tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:39 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:53:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:53:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:53:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:53:47 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:53:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:53:49 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:53:49 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:52 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 13:53:52 user nova-compute[72863]: INFO nova.compute.claims [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Claim successful on node user
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 13:53:53 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.policy [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6954653d6a934658b2b4177b4f677d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b38f98983542afa8c3bd7e16c6e7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 13:53:53 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Creating image(s)
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:53 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Successfully created port: 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG nova.virt.images [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] 5ce00e86-2fab-45af-b479-0ffbf0bed62f was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.part /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.part /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.converted" returned: 0 in 0.400s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.340s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Successfully updated port: 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json" returned: 0 in 0.207s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.compute.manager [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing instance network info cache due to event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e,backing_fmt=raw /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e,backing_fmt=raw /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk 1073741824" returned: 0 in 0.053s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json" returned: 0 in 0.194s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance network_info: |[{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Cannot resize image /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'migration_context' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Ensure instance console log exists: /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start _get_guest_xml network_info=[{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:53:50Z,direct_url=<?>,disk_format='qcow2',id=5ce00e86-2fab-45af-b479-0ffbf0bed62f,min_disk=0,min_ram=0,name='tempest-scenario-img--580294252',owner='79b38f98983542afa8c3bd7e16c6e7cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:53:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '5ce00e86-2fab-45af-b479-0ffbf0bed62f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:55 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:53:55 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:53:50Z,direct_url=<?>,disk_format='qcow2',id=5ce00e86-2fab-45af-b479-0ffbf0bed62f,min_disk=0,min_ram=0,name='tempest-scenario-img--580294252',owner='79b38f98983542afa8c3bd7e16c6e7cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:53:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:53:53Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'pci_devices' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:53:55 user nova-compute[72863]:   <uuid>ec76d34a-82b9-4992-8e4d-70d3eaab898f</uuid>
Aug 15 13:53:55 user nova-compute[72863]:   <name>instance-00000033</name>
Aug 15 13:53:55 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:53:55 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:53:55 user nova-compute[72863]:   <metadata>
Aug 15 13:53:55 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:53:55 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:name>tempest-TestMinimumBasicScenario-server-991019770</nova:name>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:53:55</nova:creationTime>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:53:55 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:53:55 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:owner>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:user uuid="6954653d6a934658b2b4177b4f677d55">tempest-TestMinimumBasicScenario-459527146-project-member</nova:user>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:project uuid="79b38f98983542afa8c3bd7e16c6e7cf">tempest-TestMinimumBasicScenario-459527146</nova:project>
Aug 15 13:53:55 user nova-compute[72863]:       </nova:owner>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:root type="image" uuid="5ce00e86-2fab-45af-b479-0ffbf0bed62f"/>
Aug 15 13:53:55 user nova-compute[72863]:       <nova:ports>
Aug 15 13:53:55 user nova-compute[72863]:         <nova:port uuid="88c2fe12-ed30-482b-92e5-3dc45a1a9b90">
Aug 15 13:53:55 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:53:55 user nova-compute[72863]:         </nova:port>
Aug 15 13:53:55 user nova-compute[72863]:       </nova:ports>
Aug 15 13:53:55 user nova-compute[72863]:     </nova:instance>
Aug 15 13:53:55 user nova-compute[72863]:   </metadata>
Aug 15 13:53:55 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:53:55 user nova-compute[72863]:     <system>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="serial">ec76d34a-82b9-4992-8e4d-70d3eaab898f</entry>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="uuid">ec76d34a-82b9-4992-8e4d-70d3eaab898f</entry>
Aug 15 13:53:55 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:53:55 user nova-compute[72863]:     </system>
Aug 15 13:53:55 user nova-compute[72863]:   </sysinfo>
Aug 15 13:53:55 user nova-compute[72863]:   <os>
Aug 15 13:53:55 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:53:55 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:53:55 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:53:55 user nova-compute[72863]:   </os>
Aug 15 13:53:55 user nova-compute[72863]:   <features>
Aug 15 13:53:55 user nova-compute[72863]:     <acpi/>
Aug 15 13:53:55 user nova-compute[72863]:     <apic/>
Aug 15 13:53:55 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:53:55 user nova-compute[72863]:   </features>
Aug 15 13:53:55 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:53:55 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:53:55 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:53:55 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:53:55 user nova-compute[72863]:   </clock>
Aug 15 13:53:55 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:53:55 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:53:55 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:53:55 user nova-compute[72863]:   </cpu>
Aug 15 13:53:55 user nova-compute[72863]:   <devices>
Aug 15 13:53:55 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:53:55 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:53:55 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk"/>
Aug 15 13:53:55 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:53:55 user nova-compute[72863]:     </disk>
Aug 15 13:53:55 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:53:55 user nova-compute[72863]:       <mac address="fa:16:3e:07:95:82"/>
Aug 15 13:53:55 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:53:55 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:53:55 user nova-compute[72863]:       <target dev="tap88c2fe12-ed"/>
Aug 15 13:53:55 user nova-compute[72863]:     </interface>
Aug 15 13:53:55 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:53:55 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/console.log" append="off"/>
Aug 15 13:53:55 user nova-compute[72863]:     </serial>
Aug 15 13:53:55 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:53:55 user nova-compute[72863]:     <video>
Aug 15 13:53:55 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:53:55 user nova-compute[72863]:     </video>
Aug 15 13:53:55 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:53:55 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:53:55 user nova-compute[72863]:     </rng>
Aug 15 13:53:55 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:53:55 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:53:55 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:53:55 user nova-compute[72863]:     </memballoon>
Aug 15 13:53:55 user nova-compute[72863]:   </devices>
Aug 15 13:53:55 user nova-compute[72863]: </domain>
Aug 15 13:53:55 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:53:53Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG os_vif [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88c2fe12-ed, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88c2fe12-ed, col_values=(('external_ids', {'iface-id': '88c2fe12-ed30-482b-92e5-3dc45a1a9b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:95:82', 'vm-uuid': 'ec76d34a-82b9-4992-8e4d-70d3eaab898f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:55 user nova-compute[72863]: INFO os_vif [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed')
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No VIF found with MAC fa:16:3e:07:95:82, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated VIF entry in instance network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG nova.network.neutron [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:53:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-2ceb0e2e-4d33-45da-b1cb-0c969d1b5d4f req-fb1b0051-da2a-4349-b9a4-bb78798b95d9 service nova] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:53:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG nova.compute.manager [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:53:57 user nova-compute[72863]: WARNING nova.compute.manager [req-af545de6-605b-4766-a496-4180979de189 req-40e7bade-d0f7-4a93-8116-961f2152ec3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state building and task_state spawning.
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107639.3200865, ec76d34a-82b9-4992-8e4d-70d3eaab898f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] VM Resumed (Lifecycle Event)
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance spawned successfully.
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107639.323302, ec76d34a-82b9-4992-8e4d-70d3eaab898f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] VM Started (Lifecycle Event)
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:53:59 user nova-compute[72863]: WARNING nova.compute.manager [req-58861f32-9d20-4154-a607-0a967b5cbb1e req-a0c15460-1116-4dd2-83dd-e7a534423d3a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state building and task_state spawning.
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 15 13:53:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:53:59 user nova-compute[72863]: INFO nova.compute.manager [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Took 6.67 seconds to build instance.
Aug 15 13:53:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-55864d58-2f53-4369-bd84-d87f294b9a7d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.762s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG nova.objects.instance [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:54:30 user nova-compute[72863]: INFO nova.compute.manager [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attaching volume f7d13160-242b-44d8-8045-cc7a222f4390 to /dev/vdb
Aug 15 13:54:30 user nova-compute[72863]: DEBUG os_brick.utils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55041f21-6e71-436e-ad59-70f84cd7d61f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c168ce-5d4b-4122-b80a-d6d4cc4c2680]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6078e6e-1da7-4131-aee8-8d4185206738]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af7386-f473-40dc-b904-1cf0a135ea5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:54:30 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:54:31 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:54:31 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c870ea4-10e9-454d-a96e-3a6efea3055e]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG os_brick.utils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating existing volume attachment record: 7fe0e6d0-0c7a-4226-b5ad-dab1bb7a3c33 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:54:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:34 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:54:35 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.392311096191406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:54:35 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjPYfRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:54:39 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:54:39 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:54:39 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216e60e-398f-4336-9527-4892e8644ada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:54:39 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c62a08-dcc4-4ae1-9253-c823f0101b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390] added
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[823e8854-72e0-4db0-8bf4-a31c43fc7f29]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824ca41-d4bb-425c-b66a-6fc3cf72f733]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSjPYfRi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSjPYfRi" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260d619-4fba-46ea-9248-e8b05a7d06bd]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oSjPYfRi'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df83a13-f3c6-4fea-bbfd-aeacabf55cdb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab23098-5171-4421-b386-37c07242dece]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c68a6-9fc8-45d9-816c-dc652346cf2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260]
Aug 15 13:54:39 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260] successful.
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcc9206-d326-49c6-8d87-96498c33af3f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f9b969-209f-42dc-8995-100b4b3e386a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)
Aug 15 13:54:39 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd06051-c505-4401-8688-1c2be1496379]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:54:39 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjPYfRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26138383630326639', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138383630326639', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG nova.objects.instance [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:54:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:54:40 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:54:40 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:54:40 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:54:40 user nova-compute[72863]:   <serial>f7d13160-242b-44d8-8045-cc7a222f4390</serial>
Aug 15 13:54:40 user nova-compute[72863]: </disk>
Aug 15 13:54:40 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No VIF found with MAC fa:16:3e:3c:38:de, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-309b306b-f17b-4d8c-bf7b-4d7b3ac12540 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.562s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:54:43 user nova-compute[72863]: INFO nova.compute.manager [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Detaching volume f7d13160-242b-44d8-8045-cc7a222f4390
Aug 15 13:54:43 user nova-compute[72863]: INFO nova.virt.block_device [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attempting to driver detach volume f7d13160-242b-44d8-8045-cc7a222f4390 from mountpoint /dev/vdb
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Attempting to detach device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:54:43 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:54:43 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:54:43 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:54:43 user nova-compute[72863]:   <serial>f7d13160-242b-44d8-8045-cc7a222f4390</serial>
Aug 15 13:54:43 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:54:43 user nova-compute[72863]: </disk>
Aug 15 13:54:43 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:54:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config.
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:54:43 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:54:43 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:54:43 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:54:43 user nova-compute[72863]:   <serial>f7d13160-242b-44d8-8045-cc7a222f4390</serial>
Aug 15 13:54:43 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:54:43 user nova-compute[72863]: </disk>
Aug 15 13:54:43 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107683.7407022, fac848d8-4f39-4963-8930-6c13cd899bdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:54:43 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config.
Aug 15 13:54:43 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjPYfRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:54:43 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820a07e-4c2d-4eec-8ef5-415533201da1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294292f-2d5b-41fc-8df9-7e413d96168f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:43 user nova-compute[72863]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)
Aug 15 13:54:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad307fa-bb30-49c0-82d3-fadfb7c9a1b5 (non-flash)
Aug 15 13:54:43 user nova-compute[72863]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 (non-flash)
Aug 15 13:54:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5243a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88db968-e5fe-4097-8b42-156aa8012729]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a67361-1843-4fdb-b3bc-2170cdefb343]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82193c3f-09db-4f9d-92d8-d795a865af7c]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04625ac3-888f-462e-96f3-5b8c062421c3]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b7bd9-5bc6-4cca-bc79-9bab0cf5e064]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a890e5-e491-4b1f-b930-43f1c901652f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:43 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260]
Aug 15 13:54:43 user nova-compute[72863]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390, portal: 172.16.0.220,3260] successful.
Aug 15 13:54:43 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d13160-242b-44d8-8045-cc7a222f4390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6049a8-4f53-4bf5-9fb2-2788e379098f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== disconnect_volume: return (271ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG nova.objects.instance [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:54:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-615314e5-bfd3-4a2a-9b40-addc1ed61e68 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:54:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:54:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:54:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:54:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:36 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:55:37 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.390422821044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:37 user nova-compute[72863]: INFO nova.compute.manager [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attaching volume d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 to /dev/vdb
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.utils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc3cd32-8d0a-439e-9dc9-cc8f26b7240a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f7fa8-bc1c-4e3e-9bd8-8bf3197d652b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2518a987-5a46-499f-8eb4-6ac3dbfe047a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[71522cdc-89f3-4c28-8212-0a922ee490f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:55:37 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:55:37 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b05af0-1148-4a3a-af6e-4f72b8e2fa11]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG os_brick.utils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:55:37 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating existing volume attachment record: 70ae87bd-0435-4011-b818-ae8d37556d46 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:55:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:44 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:55:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUBNwDnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:55:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:55:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:55:46 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23fb34-3c70-43e1-bf82-b616d0809281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:55:46 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6cd629-ab6f-41b5-956b-40e9b7d48b2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7] added
Aug 15 13:55:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6496e01-ca11-4c2e-b38f-70c903077107]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe163e5-a641-40f8-b4df-ba7274640df2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUBNwDnz {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUBNwDnz" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba3c87-6263-4626-8715-f66b1f2164f2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rUBNwDnz'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c0b6dd-28f2-4890-b89c-d7b13ad6fb26]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df176a1-c647-446c-a85a-83914733136f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:55:46 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:55:46 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:55:46 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:55:46 user nova-compute[72863]: 
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69970e-94d0-4222-9e91-0a00c3386b63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260]
Aug 15 13:55:46 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260] successful.
Aug 15 13:55:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a854e9d-f84d-478c-8968-b53d4e2d1320]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7350b182-8cb2-4db7-b390-f38ee91ae59a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)
Aug 15 13:55:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)
Aug 15 13:55:46 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100d6a2-4ba5-4998-9d7e-b04329732079]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:46 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:47 user nova-compute[72863]: INFO nova.compute.manager [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Attaching volume d301a0e9-8e5d-4d4c-903d-3fac28e70f65 to /dev/vdb
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.utils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc40042-a702-4465-8d63-38021b7dfbdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b30e8-eb32-4359-a89c-eb28a5e2426b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9923c60b-a36b-438f-856c-6a4685acc4fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18868394-d3db-48b7-95c6-e30c1e8099f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUBNwDnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23730643030363434', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730643030363434', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG nova.objects.instance [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:55:47 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:55:47 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba2eb4d-d1e1-40e7-a948-abd7a15a3709]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG os_brick.utils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating existing volume attachment record: 98eadeb2-4740-4dd0-b944-4920b14c4fa5 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:55:47 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:55:47 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:55:47 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:55:47 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:55:47 user nova-compute[72863]:   <serial>d0bee8e3-c03f-4164-a42c-d3954d8a3fe7</serial>
Aug 15 13:55:47 user nova-compute[72863]: </disk>
Aug 15 13:55:47 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No VIF found with MAC fa:16:3e:3c:38:de, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:55:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-8f7000e0-579b-4d34-822a-ebfbf87d612f tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.775s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:55:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:55:51 user nova-compute[72863]: INFO nova.compute.manager [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Detaching volume d0bee8e3-c03f-4164-a42c-d3954d8a3fe7
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:55:51 user nova-compute[72863]: INFO nova.virt.block_device [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attempting to driver detach volume d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 from mountpoint /dev/vdb
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Attempting to detach device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:55:51 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:55:51 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:55:51 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:55:51 user nova-compute[72863]:   <serial>d0bee8e3-c03f-4164-a42c-d3954d8a3fe7</serial>
Aug 15 13:55:51 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:55:51 user nova-compute[72863]: </disk>
Aug 15 13:55:51 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:55:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config.
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:55:51 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:55:51 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:55:51 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:55:51 user nova-compute[72863]:   <serial>d0bee8e3-c03f-4164-a42c-d3954d8a3fe7</serial>
Aug 15 13:55:51 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:55:51 user nova-compute[72863]: </disk>
Aug 15 13:55:51 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107751.7483175, fac848d8-4f39-4963-8930-6c13cd899bdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:55:51 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config.
Aug 15 13:55:51 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUBNwDnz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:55:51 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23072450-9665-4b73-a486-68e978e2c2f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d891d50-fdd0-43aa-947b-c775152966f7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)
Aug 15 13:55:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 (non-flash)
Aug 15 13:55:51 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c330dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cfe663-af9f-471f-88cf-ebc7fb39ba11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d6000d-2646-4e86-9bca-5b50df2caaca]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ac362-a401-4a2c-86bd-2094ff097a75]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e948194-f5ba-4feb-bc2a-51448b5e23a8]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e039b-f0b8-4af3-89cc-0b5647e3faca]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:51 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4728c9-6c42-4bd4-8da3-8663c720b81f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260]
Aug 15 13:55:52 user nova-compute[72863]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7, portal: 172.16.0.220,3260] successful.
Aug 15 13:55:52 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0bee8e3-c03f-4164-a42c-d3954d8a3fe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab8038-f48a-4885-a46d-fe3b6a3a738e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== disconnect_volume: return (275ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG nova.objects.instance [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:55:52 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-24f6245d-fded-495d-a06d-147bbf6a233b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:55:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:55:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:55:56 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:55:56 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:55:56 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc237235-9ed2-4e2e-b622-163b6abae89f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:55:56 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed45bd-b222-476f-ad2f-19675fbf130f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65] added
Aug 15 13:55:56 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8640a7ee-d116-4375-8ce0-d17d004e5d73]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26abb17-e8c9-46df-8b84-dee029bb6342]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHsdgrZY {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHsdgrZY" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a179b-f0d8-427a-a92b-70d55f1a0ccb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHsdgrZY'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc39bd-23f8-432b-97b0-2344ce2ec558]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd37731-19d5-4084-b815-cd1109990294]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:55:56 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:55:56 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:55:56 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:55:56 user nova-compute[72863]: 
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f252d-08bd-4e8e-a90b-e4c4cfb012dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]
Aug 15 13:55:56 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.
Aug 15 13:55:56 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ffe4a-631b-49b7-81f3-e3ec69a3b625]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e3247d-4195-4c12-93c0-5987b0c7a6c2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:55:56 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:55:56 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdba593-088f-4776-8747-59aa46fdcb3c]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:55:56 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26230663562316163', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230663562316163', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG nova.objects.instance [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:55:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:55:57 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:55:57 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:55:57 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:55:57 user nova-compute[72863]:   <serial>d301a0e9-8e5d-4d4c-903d-3fac28e70f65</serial>
Aug 15 13:55:57 user nova-compute[72863]: </disk>
Aug 15 13:55:57 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:55:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:55:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:55:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No VIF found with MAC fa:16:3e:07:95:82, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:55:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-86a27019-7d23-4079-af9b-8068e9e00f7e tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.521s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing instance network info cache due to event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated VIF entry in instance network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:56:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e3939494-bd96-4fb3-839c-f96f8835fde3 req-98533409-fc96-43eb-8873-6059af6bf88c service nova] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing instance network info cache due to event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated VIF entry in instance network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:56:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:56:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e6a6915e-09ad-4a09-ad02-2595052cbbe0 req-c487800a-8afe-416c-b814-65ec86131a61 service nova] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:56:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:16 user nova-compute[72863]: INFO nova.compute.manager [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Rebooting instance
Aug 15 13:56:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:56:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:56:16 user nova-compute[72863]: DEBUG nova.network.neutron [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG nova.network.neutron [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG nova.compute.manager [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:17 user nova-compute[72863]: DEBUG nova.compute.manager [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:56:17 user nova-compute[72863]: WARNING nova.compute.manager [req-a63b0047-409c-4649-a9de-4220339eb36e req-451488b4-7c83-493a-9781-0a44c00fd581 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 13:56:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance destroyed successfully.
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'resources' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:56:17Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88c2fe12-ed, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:18 user nova-compute[72863]: INFO os_vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed')
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:56:18 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e380b2-ce7b-4cc4-b6da-6c1628fe032f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b353ce-e9c0-4425-8824-a6d2b494f0a7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c34e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06a615-185b-4dd6-9c28-2bdbbd8adb4f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3362813-9ac0-4cc7-a1bd-28f410747267]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977017a-3545-49d4-89d2-70111a5dadde]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d2cf9-fb52-4697-a6c6-d9696712ccb0]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41bd43-85cd-46c3-829e-788dbe3cccdb]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[357fd9a6-1559-48ae-a2ec-75ae7c14bad5]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]
Aug 15 13:56:18 user nova-compute[72863]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67b1d2-f8f3-4533-8289-e4ca4c16e43e]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== disconnect_volume: return (261ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start _get_guest_xml network_info=[{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ce00e86-2fab-45af-b479-0ffbf0bed62f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '5ce00e86-2fab-45af-b479-0ffbf0bed62f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98eadeb2-4740-4dd0-b944-4920b14c4fa5', 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ec76d34a-82b9-4992-8e4d-70d3eaab898f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd301a0e9-8e5d-4d4c-903d-3fac28e70f65', 'serial': 'd301a0e9-8e5d-4d4c-903d-3fac28e70f65'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 13:56:18 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:56:18 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5ce00e86-2fab-45af-b479-0ffbf0bed62f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.objects.instance [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:56:18 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:18 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:18 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dea9fe-6d77-432f-ae34-21f64b5513ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:56:18 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d605ccd-a5f2-49d4-b096-924c87438481]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65] added
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc8f48-7721-4dbb-8b90-3bce9c468a14]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7342fb54-5e60-4725-a808-5fc98afb8a08]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHsdgrZY {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHsdgrZY" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b93c0-6290-47ab-be67-424aa29eef74]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHsdgrZY'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae4cfc-af09-4b32-9ae8-79f17241e8f1]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c3eec3-7c84-4218-927c-6e8540eb140d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:56:18 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 13:56:18 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:18 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 13:56:18 user nova-compute[72863]: 
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7441fb-f700-46a1-a82b-663683385156]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]
Aug 15 13:56:18 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[700bd2de-01bd-451c-9256-6c6559a271d2]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0993e7b6-b44d-4daa-85f1-6f53ed0876b7]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:18 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc6f5da-6ce1-4309-a390-52dc35533f94]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:18 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.compute.manager [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:56:19 user nova-compute[72863]: WARNING nova.compute.manager [req-c980151f-78f6-4eb0-8d70-b10085f060f1 req-3aaf22af-c7eb-410d-89df-3c48e9f7a0e2 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 13:56:19 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26230663562316163', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230663562316163', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:56:17Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.objects.instance [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'pci_devices' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 13:56:19 user nova-compute[72863]:   <uuid>ec76d34a-82b9-4992-8e4d-70d3eaab898f</uuid>
Aug 15 13:56:19 user nova-compute[72863]:   <name>instance-00000033</name>
Aug 15 13:56:19 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 13:56:19 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 13:56:19 user nova-compute[72863]:   <metadata>
Aug 15 13:56:19 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 13:56:19 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:name>tempest-TestMinimumBasicScenario-server-991019770</nova:name>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:creationTime>2023-08-15 13:56:18</nova:creationTime>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 13:56:19 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 13:56:19 user nova-compute[72863]:       </nova:flavor>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:owner>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:user uuid="6954653d6a934658b2b4177b4f677d55">tempest-TestMinimumBasicScenario-459527146-project-member</nova:user>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:project uuid="79b38f98983542afa8c3bd7e16c6e7cf">tempest-TestMinimumBasicScenario-459527146</nova:project>
Aug 15 13:56:19 user nova-compute[72863]:       </nova:owner>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:root type="image" uuid="5ce00e86-2fab-45af-b479-0ffbf0bed62f"/>
Aug 15 13:56:19 user nova-compute[72863]:       <nova:ports>
Aug 15 13:56:19 user nova-compute[72863]:         <nova:port uuid="88c2fe12-ed30-482b-92e5-3dc45a1a9b90">
Aug 15 13:56:19 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 13:56:19 user nova-compute[72863]:         </nova:port>
Aug 15 13:56:19 user nova-compute[72863]:       </nova:ports>
Aug 15 13:56:19 user nova-compute[72863]:     </nova:instance>
Aug 15 13:56:19 user nova-compute[72863]:   </metadata>
Aug 15 13:56:19 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 13:56:19 user nova-compute[72863]:     <system>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="serial">ec76d34a-82b9-4992-8e4d-70d3eaab898f</entry>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="uuid">ec76d34a-82b9-4992-8e4d-70d3eaab898f</entry>
Aug 15 13:56:19 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 13:56:19 user nova-compute[72863]:     </system>
Aug 15 13:56:19 user nova-compute[72863]:   </sysinfo>
Aug 15 13:56:19 user nova-compute[72863]:   <os>
Aug 15 13:56:19 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 13:56:19 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 13:56:19 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 13:56:19 user nova-compute[72863]:   </os>
Aug 15 13:56:19 user nova-compute[72863]:   <features>
Aug 15 13:56:19 user nova-compute[72863]:     <acpi/>
Aug 15 13:56:19 user nova-compute[72863]:     <apic/>
Aug 15 13:56:19 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 13:56:19 user nova-compute[72863]:   </features>
Aug 15 13:56:19 user nova-compute[72863]:   <clock offset="utc">
Aug 15 13:56:19 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 13:56:19 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 13:56:19 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 13:56:19 user nova-compute[72863]:   </clock>
Aug 15 13:56:19 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 13:56:19 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 13:56:19 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 13:56:19 user nova-compute[72863]:   </cpu>
Aug 15 13:56:19 user nova-compute[72863]:   <devices>
Aug 15 13:56:19 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 13:56:19 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 13:56:19 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk"/>
Aug 15 13:56:19 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 13:56:19 user nova-compute[72863]:     </disk>
Aug 15 13:56:19 user nova-compute[72863]:     <disk type="block" device="disk">
Aug 15 13:56:19 user nova-compute[72863]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:56:19 user nova-compute[72863]:       <source dev="/dev/sdb"/>
Aug 15 13:56:19 user nova-compute[72863]:       <target dev="vdb" bus="virtio"/>
Aug 15 13:56:19 user nova-compute[72863]:       <serial>d301a0e9-8e5d-4d4c-903d-3fac28e70f65</serial>
Aug 15 13:56:19 user nova-compute[72863]:     </disk>
Aug 15 13:56:19 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 13:56:19 user nova-compute[72863]:       <mac address="fa:16:3e:07:95:82"/>
Aug 15 13:56:19 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:56:19 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 13:56:19 user nova-compute[72863]:       <target dev="tap88c2fe12-ed"/>
Aug 15 13:56:19 user nova-compute[72863]:     </interface>
Aug 15 13:56:19 user nova-compute[72863]:     <serial type="pty">
Aug 15 13:56:19 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/console.log" append="off"/>
Aug 15 13:56:19 user nova-compute[72863]:     </serial>
Aug 15 13:56:19 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 13:56:19 user nova-compute[72863]:     <video>
Aug 15 13:56:19 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 13:56:19 user nova-compute[72863]:     </video>
Aug 15 13:56:19 user nova-compute[72863]:     <rng model="virtio">
Aug 15 13:56:19 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 13:56:19 user nova-compute[72863]:     </rng>
Aug 15 13:56:19 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 13:56:19 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 13:56:19 user nova-compute[72863]:       <stats period="10"/>
Aug 15 13:56:19 user nova-compute[72863]:     </memballoon>
Aug 15 13:56:19 user nova-compute[72863]:   </devices>
Aug 15 13:56:19 user nova-compute[72863]: </domain>
Aug 15 13:56:19 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 13:56:19 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.objects.instance [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'trusted_certs' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Cannot resize image /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.objects.instance [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'migration_context' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T13:56:17Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG os_vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88c2fe12-ed, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88c2fe12-ed, col_values=(('external_ids', {'iface-id': '88c2fe12-ed30-482b-92e5-3dc45a1a9b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:95:82', 'vm-uuid': 'ec76d34a-82b9-4992-8e4d-70d3eaab898f'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:20 user nova-compute[72863]: INFO os_vif [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed')
Aug 15 13:56:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG nova.compute.manager [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG nova.compute.manager [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:56:22 user nova-compute[72863]: WARNING nova.compute.manager [req-ed73a068-9276-4a30-a83f-29fba2010709 req-1c74d27b-451f-4982-b85a-ebab36a795da service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 13:56:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for ec76d34a-82b9-4992-8e4d-70d3eaab898f due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107784.099959, ec76d34a-82b9-4992-8e4d-70d3eaab898f => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:56:24 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] VM Resumed (Lifecycle Event)
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 13:56:24 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance rebooted successfully.
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:56:24 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692107784.1012762, ec76d34a-82b9-4992-8e4d-70d3eaab898f => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:56:24 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] VM Started (Lifecycle Event)
Aug 15 13:56:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-60340c62-1b59-46b4-a8f0-0d58263edaa8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.615s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:24 user nova-compute[72863]: DEBUG nova.compute.manager [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:56:24 user nova-compute[72863]: WARNING nova.compute.manager [req-6d002de7-5dfe-45f4-a53b-b2543ed8f9bc req-6f515d1c-4a70-4d46-b92c-9f70a30d0a9c service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state active and task_state None.
Aug 15 13:56:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:38 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:56:39 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:56:39 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=25.38719940185547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:56:39 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:56:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:45 user nova-compute[72863]: INFO nova.compute.manager [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attaching volume b6e290b0-ef76-4dc8-addf-775c92befa7e to /dev/vdb
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.utils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[36052381-2a73-4704-95fd-acf842650314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa358ed0-29aa-4561-a15b-f9bfeafa00e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a107d-f212-436f-a430-8faca875c2e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44466f-f30b-4b48-9ae3-658e2c27bd11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 13:56:45 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 13:56:45 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55758b-90d8-4acf-83d7-69f339b3be2d]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG os_brick.utils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating existing volume attachment record: 3b080848-dd58-436a-a484-a6a27b31c734 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 13:56:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:56:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:50 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:51 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [{"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-fac848d8-4f39-4963-8930-6c13cd899bdb" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:56:53 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVuBibyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:56:54 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:54 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:54 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b958af3-eb7b-4602-9e8b-68e8c1665f1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 13:56:54 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9303f31e-d717-4692-9a22-b3fa7ea18937]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e] added
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e6b31-8804-4e1f-9b92-14a54f1a353f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd29c7-344f-4169-b84a-748d5c601aec]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVuBibyH {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVuBibyH" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657eadd-4195-4f05-beb0-616988f3da83]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OVuBibyH'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e50211-d380-4034-b488-a72ec10c771d]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e826caa-1a1d-46cb-a7ed-520549e68da5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d29e22-3e6f-42c5-a75e-2a2be6c8264a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260]
Aug 15 13:56:54 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260] successful.
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2167f5-3789-4e0f-8a79-c237c86402da]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8b38f-4e13-47e4-bce3-3aeb942adfa0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:54 user nova-compute[72863]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:54 user nova-compute[72863]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)
Aug 15 13:56:54 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb6caa-424d-46e9-853a-78d884adb5c6]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 13:56:54 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVuBibyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23938346362663036', 'path': '/dev/sdc'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938346362663036', 'path': '/dev/sdc'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 13:56:55 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:56:55 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:56:55 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:56:55 user nova-compute[72863]:   <serial>b6e290b0-ef76-4dc8-addf-775c92befa7e</serial>
Aug 15 13:56:55 user nova-compute[72863]: </disk>
Aug 15 13:56:55 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 13:56:55 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] No VIF found with MAC fa:16:3e:3c:38:de, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 13:56:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-a5549884-d08b-4b5d-a3ec-8cf0328a406b tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.527s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:56:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:56:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:56:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:56:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:56:57 user nova-compute[72863]: INFO nova.compute.manager [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Detaching volume b6e290b0-ef76-4dc8-addf-775c92befa7e
Aug 15 13:56:57 user nova-compute[72863]: INFO nova.virt.block_device [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Attempting to driver detach volume b6e290b0-ef76-4dc8-addf-775c92befa7e from mountpoint /dev/vdb
Aug 15 13:56:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Attempting to detach device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:56:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:56:57 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:56:57 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:56:57 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:56:57 user nova-compute[72863]:   <serial>b6e290b0-ef76-4dc8-addf-775c92befa7e</serial>
Aug 15 13:56:57 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:56:57 user nova-compute[72863]: </disk>
Aug 15 13:56:57 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:56:57 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the persistent domain config.
Aug 15 13:56:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:56:57 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:56:57 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:56:57 user nova-compute[72863]:   <source dev="/dev/sdc"/>
Aug 15 13:56:57 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:56:57 user nova-compute[72863]:   <serial>b6e290b0-ef76-4dc8-addf-775c92befa7e</serial>
Aug 15 13:56:57 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 13:56:57 user nova-compute[72863]: </disk>
Aug 15 13:56:57 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107818.2837896, fac848d8-4f39-4963-8930-6c13cd899bdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:56:58 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully detached device vdb from instance fac848d8-4f39-4963-8930-6c13cd899bdb from the live domain config.
Aug 15 13:56:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVuBibyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:56:58 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f585361-fec5-440c-90b8-529faf89d19b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d68b67c-3d42-4a98-8788-ad6e5a252e67]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:58 user nova-compute[72863]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)
Aug 15 13:56:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:56:58 user nova-compute[72863]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e (non-flash)
Aug 15 13:56:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff5306e43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e'): ({'sdc'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Removing single pathed devices sdc {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e02d7-5740-435b-844d-81db233ab110]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1994bf0-3255-4845-96c4-698d2cb024a5]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Flushing IO for device /dev/sdc {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd96ae7-66dd-4fb8-bd58-60fb0f597904]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e59423-d7f4-4083-986d-31424f0c6fc4]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] SCSI volumes sdc have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c1270-c9c4-40e7-bb52-1569ca9e509f]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6ab76-5a3b-4ca2-8d4f-5132267830aa]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260]
Aug 15 13:56:58 user nova-compute[72863]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e, portal: 172.16.0.220,3260] successful.
Aug 15 13:56:58 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e290b0-ef76-4dc8-addf-775c92befa7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f610fd-f022-4ea3-8866-8a383d97f2ec]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] <== disconnect_volume: return (273ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:56:58 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:56:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'flavor' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:56:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-3948fc4d-65f4-4d63-a7d9-1e8c4cb87883 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:57:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:57:40 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 13:57:41 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:57:41 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.378128051757812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:57:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:57:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:57:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:57:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:57:58 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing instance network info cache due to event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated VIF entry in instance network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:58:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-96e0a6fd-c39e-4f39-a3d2-077a1ee146d6 req-c5cea901-e137-4bb1-9ccc-bfede63e690a service nova] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing instance network info cache due to event network-changed-88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Refreshing network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:10 user nova-compute[72863]: INFO nova.compute.manager [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Detaching volume d301a0e9-8e5d-4d4c-903d-3fac28e70f65
Aug 15 13:58:10 user nova-compute[72863]: INFO nova.virt.block_device [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Attempting to driver detach volume d301a0e9-8e5d-4d4c-903d-3fac28e70f65 from mountpoint /dev/vdb
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Attempting to detach device vdb from instance ec76d34a-82b9-4992-8e4d-70d3eaab898f from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:58:10 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:58:10 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:58:10 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:58:10 user nova-compute[72863]:   <serial>d301a0e9-8e5d-4d4c-903d-3fac28e70f65</serial>
Aug 15 13:58:10 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:58:10 user nova-compute[72863]: </disk>
Aug 15 13:58:10 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:58:10 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully detached device vdb from instance ec76d34a-82b9-4992-8e4d-70d3eaab898f from the persistent domain config.
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec76d34a-82b9-4992-8e4d-70d3eaab898f from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 13:58:10 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 13:58:10 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 13:58:10 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 13:58:10 user nova-compute[72863]:   <serial>d301a0e9-8e5d-4d4c-903d-3fac28e70f65</serial>
Aug 15 13:58:10 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 13:58:10 user nova-compute[72863]: </disk>
Aug 15 13:58:10 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated VIF entry in instance network info cache for port 88c2fe12-ed30-482b-92e5-3dc45a1a9b90. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-272c24cf-9c23-4dd3-b909-4e48677d5d2a req-e0c1ee0b-e339-4625-aa06-b13e43d2ab03 service nova] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Verify base images {{(pid=72863) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Image id 5ce00e86-2fab-45af-b479-0ffbf0bed62f yields fingerprint 7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e {{(pid=72863) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] image 5ce00e86-2fab-45af-b479-0ffbf0bed62f at (/opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e): checking
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] image 5ce00e86-2fab-45af-b479-0ffbf0bed62f at (/opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e): image is in use {{(pid=72863) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72863) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Image id 40a3270d-656b-4d7d-8be8-25ab1ae5fd35 yields fingerprint 970e8b98e32b4b0485b665aec45e02ad7ef35c14 {{(pid=72863) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] image 40a3270d-656b-4d7d-8be8-25ab1ae5fd35 at (/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14): checking
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] image 40a3270d-656b-4d7d-8be8-25ab1ae5fd35 at (/opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14): image is in use {{(pid=72863) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] fac848d8-4f39-4963-8930-6c13cd899bdb is a valid instance name {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] fac848d8-4f39-4963-8930-6c13cd899bdb has a disk file {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692107891.247514, ec76d34a-82b9-4992-8e4d-70d3eaab898f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully detached device vdb from instance ec76d34a-82b9-4992-8e4d-70d3eaab898f from the live domain config.
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHsdgrZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 13:58:11 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb7e8f2-3739-43f9-8c22-e26ff7f036e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f525a-4c82-4f24-9487-f747902b8653]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:58:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 (non-flash)
Aug 15 13:58:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff51c4c04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f594d-69ea-4bba-a418-73a034366af2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87196734-e79c-4087-ad1a-fc667183fd34]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance fac848d8-4f39-4963-8930-6c13cd899bdb is backed by 970e8b98e32b4b0485b665aec45e02ad7ef35c14 {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] ec76d34a-82b9-4992-8e4d-70d3eaab898f is a valid instance name {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] ec76d34a-82b9-4992-8e4d-70d3eaab898f has a disk file {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[74963f4e-d467-4334-abd3-09b46ad26389]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d13c22-e9f3-4b7d-9604-78b8ea0d17dd]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0325530e-ee7b-444a-bcca-217856ff98dc]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f is backed by 7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e {{(pid=72863) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837
Aug 15 13:58:11 user nova-compute[72863]: WARNING nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Unknown base file: /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Active base files: /opt/stack/data/nova/instances/_base/7cebcb2ed36edfaeb2b43b34f14a7ac5d3ef1e3e /opt/stack/data/nova/instances/_base/970e8b98e32b4b0485b665aec45e02ad7ef35c14
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Removable base files: /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40 /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47 /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799 /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837 /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c7c99514b34b8a6c8b08458a9f56486eaf52e40
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/596a88eea11c043f009889ce87bbad05e792cc47
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/147400f35c799cc3956ae69da966c55c8b25e799
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/00c699eb9720da04cc382204e6c9abfc2b01830b
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8dc14eb62f55dcc5f5a7fa88e69853c972df0837
Aug 15 13:58:11 user nova-compute[72863]: INFO nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0398fb277e1dc8a418d7880b6ee65f332aa7fbca
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Verification complete {{(pid=72863) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Verify swap images {{(pid=72863) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.imagecache [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Verify ephemeral images {{(pid=72863) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5265b4-cfdd-4e90-bba3-6c33bf354c85]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260]
Aug 15 13:58:11 user nova-compute[72863]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65, portal: 172.16.0.220,3260] successful.
Aug 15 13:58:11 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d301a0e9-8e5d-4d4c-903d-3fac28e70f65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d89fc-f528-4413-bd35-0fc1ca9d4b80]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== disconnect_volume: return (349ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 13:58:11 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 13:58:12 user nova-compute[72863]: DEBUG nova.objects.instance [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:58:12 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-54249710-bc44-440f-972b-2d1fae20d8ac tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.923s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:26 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:26 user nova-compute[72863]: INFO nova.compute.manager [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Terminating instance
Aug 15 13:58:26 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-unplugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] No waiting events found dispatching network-vif-unplugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.compute.manager [req-b3c8bca1-01cd-4f76-8da0-b014c3284a1a req-ccaef30a-0b26-4d02-adcc-5f390531653c service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-unplugged-d5a5f301-807a-49eb-9189-b5de176a7803 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:58:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Instance destroyed successfully.
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lazy-loading 'resources' on Instance uuid fac848d8-4f39-4963-8930-6c13cd899bdb {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-940682880',display_name='tempest-SnapshotDataIntegrityTests-server-940682880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-940682880',id=50,image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSmu2acvgPB7k2V66amyonWfo+JKZr1eR8hKAKNonPYOG9/L7JQ8lR7S9IHalBrOruAcSvdbU6foP5WF6ZZtA9cj37NtsLx6s+mWDP5VQ7D9KynD+dFt6jm2+82Ao0Sfw==',key_name='tempest-keypair-893155915',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679342ef450443fe97674289f5b2098d',ramdisk_id='',reservation_id='r-pt8tgze6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40a3270d-656b-4d7d-8be8-25ab1ae5fd35',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-650013113',owner_user_name='tempest-SnapshotDataIntegrityTests-650013113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25ca34c4a7eb4e93b46acb8a9a7d709b',uuid=fac848d8-4f39-4963-8930-6c13cd899bdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converting VIF {"id": "d5a5f301-807a-49eb-9189-b5de176a7803", "address": "fa:16:3e:3c:38:de", "network": {"id": "a56bbabe-9971-4e69-8660-f935f0149e0c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-266243703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679342ef450443fe97674289f5b2098d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a5f301-80", "ovs_interfaceid": "d5a5f301-807a-49eb-9189-b5de176a7803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG os_vif [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5a5f301-80, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:27 user nova-compute[72863]: INFO os_vif [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:de,bridge_name='br-int',has_traffic_filtering=True,id=d5a5f301-807a-49eb-9189-b5de176a7803,network=Network(a56bbabe-9971-4e69-8660-f935f0149e0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a5f301-80')
Aug 15 13:58:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Deleting instance files /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb_del
Aug 15 13:58:27 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Deletion of /opt/stack/data/nova/instances/fac848d8-4f39-4963-8930-6c13cd899bdb_del complete
Aug 15 13:58:27 user nova-compute[72863]: INFO nova.compute.manager [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 13:58:27 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:58:27 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:58:28 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:58:28 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Took 0.86 seconds to deallocate network for instance.
Aug 15 13:58:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:28 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:58:28 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:58:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:28 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Deleted allocations for instance fac848d8-4f39-4963-8930-6c13cd899bdb
Aug 15 13:58:28 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f4ce11e8-1734-4c26-acf7-5fc6884c1dd1 tempest-SnapshotDataIntegrityTests-650013113 tempest-SnapshotDataIntegrityTests-650013113-project-member] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:58:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] Acquiring lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:29 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] Lock "fac848d8-4f39-4963-8930-6c13cd899bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] No waiting events found dispatching network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:58:29 user nova-compute[72863]: WARNING nova.compute.manager [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received unexpected event network-vif-plugged-d5a5f301-807a-49eb-9189-b5de176a7803 for instance with vm_state deleted and task_state None.
Aug 15 13:58:29 user nova-compute[72863]: DEBUG nova.compute.manager [req-d0dba222-3138-4164-b6e9-1120bce8354f req-b2b926b5-25cf-48fa-a6ea-d138534f3c29 service nova] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Received event network-vif-deleted-d5a5f301-807a-49eb-9189-b5de176a7803 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:58:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:41 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 13:58:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:58:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=25.404911041259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance ec76d34a-82b9-4992-8e4d-70d3eaab898f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107907.6978455, fac848d8-4f39-4963-8930-6c13cd899bdb => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:58:42 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] VM Stopped (Lifecycle Event)
Aug 15 13:58:42 user nova-compute[72863]: DEBUG nova.compute.manager [None req-0d81bc12-0197-4605-80d3-b3b5743a4ded None None] [instance: fac848d8-4f39-4963-8930-6c13cd899bdb] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:58:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:46 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:58:46 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:58:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:58:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:54 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 13:58:54 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [{"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-ec76d34a-82b9-4992-8e4d-70d3eaab898f" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 13:58:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 13:58:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:58:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 13:58:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:58:59 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:06 user nova-compute[72863]: INFO nova.compute.manager [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Terminating instance
Aug 15 13:59:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_power_states {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Triggering sync for uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.manager [req-11bf4327-b39b-4ad6-9207-81c4e5dd632a req-4e279399-82a7-48b2-bfd7-e43d1ba36d6f service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-unplugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 13:59:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Instance destroyed successfully.
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.objects.instance [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'resources' on Instance uuid ec76d34a-82b9-4992-8e4d-70d3eaab898f {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T13:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-991019770',display_name='tempest-TestMinimumBasicScenario-server-991019770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-991019770',id=51,image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3jlwLWb/a9/i0TCB1ybuWf2TK48/+hdIITsns8VI0vwGnUsB2IMRvLWeKUlwk8NOJ3WXDsvcVUyq8YVjENBYtkQ5bKwn++YpEIYy3V4iaoqNI7uGS1Z42qnPaPdffTHg==',key_name='tempest-TestMinimumBasicScenario-1478131098',keypairs=<?>,launch_index=0,launched_at=2023-08-15T13:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-zqio2nd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ce00e86-2fab-45af-b479-0ffbf0bed62f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T13:56:24Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=ec76d34a-82b9-4992-8e4d-70d3eaab898f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "address": "fa:16:3e:07:95:82", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c2fe12-ed", "ovs_interfaceid": "88c2fe12-ed30-482b-92e5-3dc45a1a9b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG os_vif [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88c2fe12-ed, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:07 user nova-compute[72863]: INFO os_vif [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:95:82,bridge_name='br-int',has_traffic_filtering=True,id=88c2fe12-ed30-482b-92e5-3dc45a1a9b90,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c2fe12-ed')
Aug 15 13:59:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Deleting instance files /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f_del
Aug 15 13:59:07 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Deletion of /opt/stack/data/nova/instances/ec76d34a-82b9-4992-8e4d-70d3eaab898f_del complete
Aug 15 13:59:07 user nova-compute[72863]: INFO nova.compute.manager [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 13:59:07 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Took 0.43 seconds to deallocate network for instance.
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:59:07 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:59:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:08 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Deleted allocations for instance ec76d34a-82b9-4992-8e4d-70d3eaab898f
Aug 15 13:59:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-2bb75f8c-e407-420a-9b21-05c2535907f8 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.554s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.125s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:08 user nova-compute[72863]: INFO nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 15 13:59:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:59:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] Acquiring lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] Lock "ec76d34a-82b9-4992-8e4d-70d3eaab898f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] No waiting events found dispatching network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 13:59:09 user nova-compute[72863]: WARNING nova.compute.manager [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received unexpected event network-vif-plugged-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 for instance with vm_state deleted and task_state None.
Aug 15 13:59:09 user nova-compute[72863]: DEBUG nova.compute.manager [req-91fc3a20-1bfe-4336-aca4-55dd257da6aa req-ec5fb8f3-a10f-4d76-977b-06f5960eb365 service nova] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Received event network-vif-deleted-88c2fe12-ed30-482b-92e5-3dc45a1a9b90 {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 13:59:12 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:17 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:22 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692107947.3221269, ec76d34a-82b9-4992-8e4d-70d3eaab898f => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 13:59:22 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] VM Stopped (Lifecycle Event)
Aug 15 13:59:22 user nova-compute[72863]: DEBUG nova.compute.manager [None req-86773a6d-bd09-42fd-9891-5af0e7515de2 None None] [instance: ec76d34a-82b9-4992-8e4d-70d3eaab898f] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 13:59:22 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:24 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:27 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:32 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:37 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:59:42 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.43146514892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 13:59:42 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:47 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 13:59:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:49 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 13:59:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 13:59:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 13:59:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 13:59:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 13:59:57 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Starting instance... {{(pid=72863) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72863) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 14:00:00 user nova-compute[72863]: INFO nova.compute.claims [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Claim successful on node user
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Start building networks asynchronously for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Allocating IP information in the background. {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] allocate_for_instance() {{(pid=72863) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 14:00:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 14:00:00 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Start building block device mappings for instance. {{(pid=72863) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.policy [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6954653d6a934658b2b4177b4f677d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b38f98983542afa8c3bd7e16c6e7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72863) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Start spawning the instance on the hypervisor. {{(pid=72863) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Creating instance directory {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 14:00:01 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Creating image(s)
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "/opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "/opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "/opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.part --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.part --force-share --output=json" returned: 0 in 0.204s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.virt.images [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] 8cfc8e76-d001-43ce-bc5d-839849c80b45 was qcow2, converting to raw {{(pid=72863) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.privsep.utils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72863) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.part /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.converted {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:01 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Successfully created port: bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.part /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.converted" returned: 0 in 0.291s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.converted --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.207s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841,backing_fmt=raw /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk 1073741824 {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841,backing_fmt=raw /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk 1073741824" returned: 0 in 0.058s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "dd0f8d351f25fcbe0bd16849d0c90530af753841" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Successfully updated port: bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing instance network info cache due to event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd0f8d351f25fcbe0bd16849d0c90530af753841 --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk. size=1073741824 {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:02 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance cache missing network info. {{(pid=72863) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.disk.api [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Cannot resize image /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk to a smaller size. {{(pid=72863) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'migration_context' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Created local disks {{(pid=72863) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Ensure instance console log exists: /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/console.log {{(pid=72863) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.neutron [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance network_info: |[{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72863) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Start _get_guest_xml network_info=[{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:59:58Z,direct_url=<?>,disk_format='qcow2',id=8cfc8e76-d001-43ce-bc5d-839849c80b45,min_disk=0,min_ram=0,name='tempest-scenario-img--33834409',owner='79b38f98983542afa8c3bd7e16c6e7cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:59:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8cfc8e76-d001-43ce-bc5d-839849c80b45'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 14:00:03 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:00:03 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller missing on host. {{(pid=72863) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU controller found on host. {{(pid=72863) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72863) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T13:18:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T13:59:58Z,direct_url=<?>,disk_format='qcow2',id=8cfc8e76-d001-43ce-bc5d-839849c80b45,min_disk=0,min_ram=0,name='tempest-scenario-img--33834409',owner='79b38f98983542afa8c3bd7e16c6e7cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T13:59:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image limits 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flavor pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Image pref 0:0:0 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Got 1 possible topologies {{(pid=72863) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.hardware [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72863) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T14:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-492881575',display_name='tempest-TestMinimumBasicScenario-server-492881575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-492881575',id=52,image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS9v2n9tOObUYih63C7NsGUbUY7IuONORlCHEbwj3KzFMVn6HpIKhNl9QTLZBr4mTWQtdzyIBIM0poNuGcBg8+UVaJ3t68e9bzyArxvEU6whXQv7fw0kj87dB4B418Pag==',key_name='tempest-TestMinimumBasicScenario-771524295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-ta23n206',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T14:00:01Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=f85f0542-0296-4866-a170-918b2fdd64ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72863) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.objects.instance [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'pci_devices' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] End _get_guest_xml xml=<domain type="kvm">
Aug 15 14:00:03 user nova-compute[72863]:   <uuid>f85f0542-0296-4866-a170-918b2fdd64ca</uuid>
Aug 15 14:00:03 user nova-compute[72863]:   <name>instance-00000034</name>
Aug 15 14:00:03 user nova-compute[72863]:   <memory>524288</memory>
Aug 15 14:00:03 user nova-compute[72863]:   <vcpu>1</vcpu>
Aug 15 14:00:03 user nova-compute[72863]:   <metadata>
Aug 15 14:00:03 user nova-compute[72863]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 14:00:03 user nova-compute[72863]:       <nova:package version="0.0.0"/>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:name>tempest-TestMinimumBasicScenario-server-492881575</nova:name>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:creationTime>2023-08-15 14:00:03</nova:creationTime>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:flavor name="m1.tiny">
Aug 15 14:00:03 user nova-compute[72863]:         <nova:memory>512</nova:memory>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:disk>1</nova:disk>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:swap>0</nova:swap>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:vcpus>1</nova:vcpus>
Aug 15 14:00:03 user nova-compute[72863]:       </nova:flavor>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:owner>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:user uuid="6954653d6a934658b2b4177b4f677d55">tempest-TestMinimumBasicScenario-459527146-project-member</nova:user>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:project uuid="79b38f98983542afa8c3bd7e16c6e7cf">tempest-TestMinimumBasicScenario-459527146</nova:project>
Aug 15 14:00:03 user nova-compute[72863]:       </nova:owner>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:root type="image" uuid="8cfc8e76-d001-43ce-bc5d-839849c80b45"/>
Aug 15 14:00:03 user nova-compute[72863]:       <nova:ports>
Aug 15 14:00:03 user nova-compute[72863]:         <nova:port uuid="bf4576f6-5564-4502-8ea9-c608dd3e5e6a">
Aug 15 14:00:03 user nova-compute[72863]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 14:00:03 user nova-compute[72863]:         </nova:port>
Aug 15 14:00:03 user nova-compute[72863]:       </nova:ports>
Aug 15 14:00:03 user nova-compute[72863]:     </nova:instance>
Aug 15 14:00:03 user nova-compute[72863]:   </metadata>
Aug 15 14:00:03 user nova-compute[72863]:   <sysinfo type="smbios">
Aug 15 14:00:03 user nova-compute[72863]:     <system>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="product">OpenStack Nova</entry>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="version">0.0.0</entry>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="serial">f85f0542-0296-4866-a170-918b2fdd64ca</entry>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="uuid">f85f0542-0296-4866-a170-918b2fdd64ca</entry>
Aug 15 14:00:03 user nova-compute[72863]:       <entry name="family">Virtual Machine</entry>
Aug 15 14:00:03 user nova-compute[72863]:     </system>
Aug 15 14:00:03 user nova-compute[72863]:   </sysinfo>
Aug 15 14:00:03 user nova-compute[72863]:   <os>
Aug 15 14:00:03 user nova-compute[72863]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 14:00:03 user nova-compute[72863]:     <boot dev="hd"/>
Aug 15 14:00:03 user nova-compute[72863]:     <smbios mode="sysinfo"/>
Aug 15 14:00:03 user nova-compute[72863]:   </os>
Aug 15 14:00:03 user nova-compute[72863]:   <features>
Aug 15 14:00:03 user nova-compute[72863]:     <acpi/>
Aug 15 14:00:03 user nova-compute[72863]:     <apic/>
Aug 15 14:00:03 user nova-compute[72863]:     <vmcoreinfo/>
Aug 15 14:00:03 user nova-compute[72863]:   </features>
Aug 15 14:00:03 user nova-compute[72863]:   <clock offset="utc">
Aug 15 14:00:03 user nova-compute[72863]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 14:00:03 user nova-compute[72863]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 14:00:03 user nova-compute[72863]:     <timer name="hpet" present="no"/>
Aug 15 14:00:03 user nova-compute[72863]:   </clock>
Aug 15 14:00:03 user nova-compute[72863]:   <cpu mode="custom" match="exact">
Aug 15 14:00:03 user nova-compute[72863]:     <model>Nehalem</model>
Aug 15 14:00:03 user nova-compute[72863]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 14:00:03 user nova-compute[72863]:   </cpu>
Aug 15 14:00:03 user nova-compute[72863]:   <devices>
Aug 15 14:00:03 user nova-compute[72863]:     <disk type="file" device="disk">
Aug 15 14:00:03 user nova-compute[72863]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 14:00:03 user nova-compute[72863]:       <source file="/opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk"/>
Aug 15 14:00:03 user nova-compute[72863]:       <target dev="vda" bus="virtio"/>
Aug 15 14:00:03 user nova-compute[72863]:     </disk>
Aug 15 14:00:03 user nova-compute[72863]:     <interface type="ethernet">
Aug 15 14:00:03 user nova-compute[72863]:       <mac address="fa:16:3e:5f:fa:01"/>
Aug 15 14:00:03 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 14:00:03 user nova-compute[72863]:       <mtu size="1442"/>
Aug 15 14:00:03 user nova-compute[72863]:       <target dev="tapbf4576f6-55"/>
Aug 15 14:00:03 user nova-compute[72863]:     </interface>
Aug 15 14:00:03 user nova-compute[72863]:     <serial type="pty">
Aug 15 14:00:03 user nova-compute[72863]:       <log file="/opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/console.log" append="off"/>
Aug 15 14:00:03 user nova-compute[72863]:     </serial>
Aug 15 14:00:03 user nova-compute[72863]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 14:00:03 user nova-compute[72863]:     <video>
Aug 15 14:00:03 user nova-compute[72863]:       <model type="virtio"/>
Aug 15 14:00:03 user nova-compute[72863]:     </video>
Aug 15 14:00:03 user nova-compute[72863]:     <rng model="virtio">
Aug 15 14:00:03 user nova-compute[72863]:       <backend model="random">/dev/urandom</backend>
Aug 15 14:00:03 user nova-compute[72863]:     </rng>
Aug 15 14:00:03 user nova-compute[72863]:     <controller type="usb" index="0" model="none"/>
Aug 15 14:00:03 user nova-compute[72863]:     <memballoon model="virtio">
Aug 15 14:00:03 user nova-compute[72863]:       <stats period="10"/>
Aug 15 14:00:03 user nova-compute[72863]:     </memballoon>
Aug 15 14:00:03 user nova-compute[72863]:   </devices>
Aug 15 14:00:03 user nova-compute[72863]: </domain>
Aug 15 14:00:03 user nova-compute[72863]:  {{(pid=72863) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T14:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-492881575',display_name='tempest-TestMinimumBasicScenario-server-492881575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-492881575',id=52,image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS9v2n9tOObUYih63C7NsGUbUY7IuONORlCHEbwj3KzFMVn6HpIKhNl9QTLZBr4mTWQtdzyIBIM0poNuGcBg8+UVaJ3t68e9bzyArxvEU6whXQv7fw0kj87dB4B418Pag==',key_name='tempest-TestMinimumBasicScenario-771524295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-ta23n206',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T14:00:01Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=f85f0542-0296-4866-a170-918b2fdd64ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG os_vif [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55') {{(pid=72863) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf4576f6-55, may_exist=True, interface_attrs={}) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf4576f6-55, col_values=(('external_ids', {'iface-id': 'bf4576f6-5564-4502-8ea9-c608dd3e5e6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:fa:01', 'vm-uuid': 'f85f0542-0296-4866-a170-918b2fdd64ca'}),), if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:03 user nova-compute[72863]: INFO os_vif [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55')
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No VIF found with MAC fa:16:3e:5f:fa:01, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated VIF entry in instance network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:00:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-7ddf863a-d7ee-4499-86e7-f2a9dbd97b60 req-1ff12806-badf-4ea3-bf76-ee8748fcd30a service nova] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:04 user nova-compute[72863]: DEBUG nova.compute.manager [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:00:04 user nova-compute[72863]: WARNING nova.compute.manager [req-8de29b6e-cedb-44f5-91a2-475e7bdc9fab req-e3d9f821-6b59-45cb-9d53-22248fe72c9e service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state building and task_state spawning.
Aug 15 14:00:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692108006.7300508, f85f0542-0296-4866-a170-918b2fdd64ca => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] VM Resumed (Lifecycle Event)
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance event wait completed in 0 seconds for  {{(pid=72863) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Guest created on hypervisor {{(pid=72863) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance spawned successfully.
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_cdrom_bus of ide {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_disk_bus of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_input_bus of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_pointer_model of None {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_video_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Found default for hw_vif_model of virtio {{(pid=72863) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692108006.7327528, f85f0542-0296-4866-a170-918b2fdd64ca => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] VM Started (Lifecycle Event)
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:00:06 user nova-compute[72863]: INFO nova.compute.manager [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Took 6.32 seconds to build instance.
Aug 15 14:00:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-f1e52ec0-5a42-4168-8955-88d4ce00ae55 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.404s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:06 user nova-compute[72863]: DEBUG nova.compute.manager [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:00:06 user nova-compute[72863]: WARNING nova.compute.manager [req-448db832-8648-4005-9901-aa41a3ba957d req-816987b1-077d-4da6-ae62-f0473c064c5f service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state active and task_state None.
Aug 15 14:00:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:00:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:31 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:00:43 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:00:43 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:00:43 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.38104248046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:00:43 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f85f0542-0296-4866-a170-918b2fdd64ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:00:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:00:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:48 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:48 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:00:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:00:50 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:50 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 14:00:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:00:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:00 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:00 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:01:44 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:01:44 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:01:44 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=25.380435943603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:01:44 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f85f0542-0296-4866-a170-918b2fdd64ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:01:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:49 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:49 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:49 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:01:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:01:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:01:55 user nova-compute[72863]: INFO nova.compute.manager [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Attaching volume 1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 to /dev/vdb
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e14b4-9b09-4178-84e2-f8c80372d975]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c3c26df6e9d\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dee15e-67c2-4122-96e5-a4ee2709bc75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cdd49b-9e6c-46a1-b5e6-419b9b70d1c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a25d4e-b711-49f6-b79f-391f489b9969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Running cmd (subprocess): nvme version {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] nvme not present on system {{(pid=72863) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 14:01:55 user nova-compute[72863]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 14:01:55 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b63956-845d-4b35-9e52-250b486cec4d]: (4, '') {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72863) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] LIGHTOS: no hostnqn found. {{(pid=72863) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG os_brick.utils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c3c26df6e9d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 14:01:55 user nova-compute[72863]: DEBUG nova.virt.block_device [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating existing volume attachment record: 243e9712-d4a0-4102-be4d-1b0b7e39f112 {{(pid=72863) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 14:01:56 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:01:57 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:01:57 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:01:57 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 14:01:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:01:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:02:01 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Calling os-brick to attach iSCSI Volume {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyeKJtFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 14:02:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 14:02:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 14:02:03 user nova-compute[72863]: INFO os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9dfd1c-d92d-4b41-925c-e2f84e12c6eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 14:02:03 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd41e8-9ff6-4929-812e-1ce0a12ac35a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9] added\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9] added
Aug 15 14:02:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[626aabc8-f6f1-48f5-96d5-de253dccace6]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf5283-591a-4f54-8744-7d675e0c7777]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyeKJtFb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyeKJtFb" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21ea689-0c84-4840-af8b-675f11f17104]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MyeKJtFb'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d83746-deac-4a89-b68b-11e0e65f6c21]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1cda1f-c404-4e3a-b965-04b81747c111]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 14:02:03 user nova-compute[72863]:  {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 14:02:03 user nova-compute[72863]:  {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 14:02:03 user nova-compute[72863]: WARNING os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 14:02:03 user nova-compute[72863]: 
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --login {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d2988-0e76-4f8c-9667-189db8cc218f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260]
Aug 15 14:02:03 user nova-compute[72863]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260] successful.
Aug 15 14:02:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71e9e4a-b416-4804-a84d-4f99c5ac11f7]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08698c7-6531-4c4f-952c-1f82cf9675c2]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)
Aug 15 14:02:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)
Aug 15 14:02:03 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to 172.16.0.220:3260 {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72863) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72863) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 14:02:03 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8351431-9e3d-4cc7-ae30-d0d001ac2763]: (4, ('- - 0', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:02:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72863) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 14:02:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyeKJtFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72863) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26332376132376639', 'path': '/dev/sdb'} {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332376132376639', 'path': '/dev/sdb'} {{(pid=72863) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.objects.instance [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 14:02:05 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 14:02:05 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 14:02:05 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 14:02:05 user nova-compute[72863]:   <serial>1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9</serial>
Aug 15 14:02:05 user nova-compute[72863]: </disk>
Aug 15 14:02:05 user nova-compute[72863]:  {{(pid=72863) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72863) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] No VIF found with MAC fa:16:3e:5f:fa:01, not building metadata {{(pid=72863) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 14:02:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-7f65c584-06b7-433b-b148-dbc7217b1232 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.213s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:07 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG nova.compute.manager [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing instance network info cache due to event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG nova.network.neutron [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 14:02:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated VIF entry in instance network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 14:02:09 user nova-compute[72863]: DEBUG nova.network.neutron [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:02:09 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-ae6c6880-4021-4465-a607-12dd73a8f367 req-98c90faf-3af4-467f-b24f-e6cbc06fc3d1 service nova] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:02:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:10 user nova-compute[72863]: DEBUG nova.compute.manager [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing instance network info cache due to event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 14:02:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:02:10 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:02:10 user nova-compute[72863]: DEBUG nova.network.neutron [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:11 user nova-compute[72863]: INFO nova.compute.manager [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Rebooting instance
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated VIF entry in instance network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG nova.network.neutron [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-fee3ba28-9f8a-4b89-b7f0-f3a7112e0673 req-f12b209f-2d45-45a1-b49e-b65e9d40d52d service nova] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Building network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG nova.network.neutron [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:02:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:02:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:14 user nova-compute[72863]: DEBUG nova.compute.manager [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:02:14 user nova-compute[72863]: WARNING nova.compute.manager [req-e5dbd05a-554b-4bcc-99ee-2e608773fa44 req-f3491502-2671-40d5-81d9-c2232ac3ca9c service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state active and task_state reboot_started.
Aug 15 14:02:15 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance shutdown successfully.
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG nova.compute.manager [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:02:16 user nova-compute[72863]: WARNING nova.compute.manager [req-cb090ed5-9365-4776-a4c0-e632e80f5c82 req-edf74603-d9fd-431a-b53b-6deedd9851a4 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state active and task_state reboot_started.
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:16 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:02:18 user nova-compute[72863]: WARNING nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state active and task_state reboot_started.
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:02:18 user nova-compute[72863]: WARNING nova.compute.manager [req-6ace7665-a34b-4937-912e-addc07e82f87 req-0dde4b60-9e12-42b2-8c4d-d4b89b210249 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state active and task_state reboot_started.
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.virt.libvirt.host [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Removed pending event for f85f0542-0296-4866-a170-918b2fdd64ca due to event {{(pid=72863) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692108138.5060742, f85f0542-0296-4866-a170-918b2fdd64ca => Resumed> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 14:02:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] VM Resumed (Lifecycle Event)
Aug 15 14:02:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance running successfully.
Aug 15 14:02:18 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance soft rebooted successfully.
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 14:02:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.virt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Emitting event <LifecycleEvent: 1692108138.5092974, f85f0542-0296-4866-a170-918b2fdd64ca => Started> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 14:02:18 user nova-compute[72863]: INFO nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] VM Started (Lifecycle Event)
Aug 15 14:02:18 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-6f63a01d-7a9f-4d45-84f2-4863ba7ed482 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.331s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:02:18 user nova-compute[72863]: DEBUG nova.compute.manager [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72863) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 14:02:21 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:26 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:36 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:41 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 14:02:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:02:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:02:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.3782958984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:02:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f85f0542-0296-4866-a170-918b2fdd64ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:02:46 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:50 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:50 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:02:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:02:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:56 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:02:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 14:03:01 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:04 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72863) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 14:03:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:03:45 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:03:45 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.37777328491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:03:45 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f85f0542-0296-4866-a170-918b2fdd64ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:03:46 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:03:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:55 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 14:03:55 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] There are 0 instances to clean {{(pid=72863) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 14:03:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:03:58 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing instance network info cache due to event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:04:02 user nova-compute[72863]: DEBUG nova.network.neutron [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated VIF entry in instance network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-55dba287-5b88-4acb-b912-db892294756a req-6bb446e8-9476-4ad0-9988-ee22fbc5651b service nova] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.compute.manager [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing instance network info cache due to event network-changed-bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Refreshing network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:04:03 user nova-compute[72863]: INFO nova.compute.manager [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Detaching volume 1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9
Aug 15 14:04:03 user nova-compute[72863]: INFO nova.virt.block_device [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Attempting to driver detach volume 1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 from mountpoint /dev/vdb
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Attempting to detach device vdb from instance f85f0542-0296-4866-a170-918b2fdd64ca from the persistent domain config. {{(pid=72863) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 14:04:03 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 14:04:03 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 14:04:03 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 14:04:03 user nova-compute[72863]:   <serial>1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9</serial>
Aug 15 14:04:03 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 14:04:03 user nova-compute[72863]: </disk>
Aug 15 14:04:03 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 14:04:03 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully detached device vdb from instance f85f0542-0296-4866-a170-918b2fdd64ca from the persistent domain config.
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f85f0542-0296-4866-a170-918b2fdd64ca from the live domain config. {{(pid=72863) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 14:04:03 user nova-compute[72863]: DEBUG nova.virt.libvirt.guest [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 14:04:03 user nova-compute[72863]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 14:04:03 user nova-compute[72863]:   <source dev="/dev/sdb"/>
Aug 15 14:04:03 user nova-compute[72863]:   <target dev="vdb" bus="virtio"/>
Aug 15 14:04:03 user nova-compute[72863]:   <serial>1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9</serial>
Aug 15 14:04:03 user nova-compute[72863]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 14:04:03 user nova-compute[72863]: </disk>
Aug 15 14:04:03 user nova-compute[72863]:  {{(pid=72863) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated VIF entry in instance network info cache for port bf4576f6-5564-4502-8ea9-c608dd3e5e6a. {{(pid=72863) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.network.neutron [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-5b7136e1-440a-42f9-a7ae-44aaa060d54c req-112159f9-b62b-4b8f-bb23-73881b5d5815 service nova] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-bab8646a-00d1-4c39-927a-8ceb89659697 None None] Received event <DeviceRemovedEvent: 1692108244.344109, f85f0542-0296-4866-a170-918b2fdd64ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72863) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.driver [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 14:04:04 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully detached device vdb from instance f85f0542-0296-4866-a170-918b2fdd64ca from the live domain config.
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] calling os-brick to detach iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff5307c5060>, {'target_iqns': ['iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyeKJtFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 14:04:04 user nova-compute[72863]: WARNING os_brick.initiator.connectors.base [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9', 0)] {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e654ea3e-96cd-4a82-a08f-925e306a567a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f419d47-db4d-4bf0-9057-146897220ad5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)
Aug 15 14:04:04 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 (non-flash)
Aug 15 14:04:04 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff530863c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9'): ({'sdb'}, set())}) {{(pid=72863) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Removing single pathed devices sdb {{(pid=72863) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdddc30d-66e0-42d8-8803-77a5d6027da2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a546f7f-2dcb-4359-9507-8ef4afedec69]: (4, ('ok\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Flushing IO for device /dev/sdb {{(pid=72863) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7206d15-d79f-409a-b84e-e3ba8c606a92]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72863) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa129b-6aa4-4054-8f0f-cf790baa8b44]: (4, ('1', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.linuxscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] SCSI volumes sdb have been removed. {{(pid=72863) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9')] {{(pid=72863) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cbbce3-62ee-46c1-8426-40e47146eced]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --logout {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e3875-3773-4582-b341-db01848f85cf]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260]
Aug 15 14:04:04 user nova-compute[72863]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9, portal: 172.16.0.220,3260] successful.
Aug 15 14:04:04 user nova-compute[72863]:  stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op delete {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf37f9e-d9aa-4aaa-bff6-be41e6faf3f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84064) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da13923-8287-4666-86d3-0eacc4ca4bfe]: (4, ('', '')) {{(pid=84064) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72863) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.base [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] <== disconnect_volume: return (288ms) None {{(pid=72863) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 14:04:04 user nova-compute[72863]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Disconnected iSCSI Volume {{(pid=72863) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 14:04:05 user nova-compute[72863]: DEBUG nova.objects.instance [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'flavor' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:04:05 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-63ea812d-a677-46af-aee9-6b1d3eb97253 tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.573s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:04:06 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:08 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:11 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:11 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Cleaning up deleted instances with incomplete migration  {{(pid=72863) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 14:04:13 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:18 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:23 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:28 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:33 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:38 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:43 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.processutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 14:04:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:04:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:04:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=25.376991271972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:04:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Instance f85f0542-0296-4866-a170-918b2fdd64ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72863) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing inventories for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating ProviderTree inventory for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Updating inventory in ProviderTree for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing aggregate associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, aggregates: None {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Refreshing trait associations for resource provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=72863) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:04:48 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:52 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:52 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:52 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:04:58 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquired lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Forcefully refreshing network info cache for instance {{(pid=72863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.objects.instance [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lazy-loading 'info_cache' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:04:59 user nova-compute[72863]: INFO nova.compute.manager [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Terminating instance
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Start destroying the instance on the hypervisor. {{(pid=72863) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.network.neutron [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [{"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Releasing lock "refresh_cache-f85f0542-0296-4866-a170-918b2fdd64ca" {{(pid=72863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updated the network info_cache for instance {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:04:59 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.compute.manager [req-45da9393-0cf3-48e1-82e2-bc4dedf72640 req-e2fada98-3479-4611-833e-fd5e4810c4bd service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-unplugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with task_state deleting. {{(pid=72863) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Instance destroyed successfully.
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.objects.instance [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lazy-loading 'resources' on Instance uuid f85f0542-0296-4866-a170-918b2fdd64ca {{(pid=72863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.virt.libvirt.vif [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T14:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-492881575',display_name='tempest-TestMinimumBasicScenario-server-492881575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-492881575',id=52,image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS9v2n9tOObUYih63C7NsGUbUY7IuONORlCHEbwj3KzFMVn6HpIKhNl9QTLZBr4mTWQtdzyIBIM0poNuGcBg8+UVaJ3t68e9bzyArxvEU6whXQv7fw0kj87dB4B418Pag==',key_name='tempest-TestMinimumBasicScenario-771524295',keypairs=<?>,launch_index=0,launched_at=2023-08-15T14:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b38f98983542afa8c3bd7e16c6e7cf',ramdisk_id='',reservation_id='r-ta23n206',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cfc8e76-d001-43ce-bc5d-839849c80b45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-459527146',owner_user_name='tempest-TestMinimumBasicScenario-459527146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T14:02:19Z,user_data=None,user_id='6954653d6a934658b2b4177b4f677d55',uuid=f85f0542-0296-4866-a170-918b2fdd64ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converting VIF {"id": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "address": "fa:16:3e:5f:fa:01", "network": {"id": "806f0e12-8cbe-4548-babb-02213de4f161", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178209571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b38f98983542afa8c3bd7e16c6e7cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf4576f6-55", "ovs_interfaceid": "bf4576f6-5564-4502-8ea9-c608dd3e5e6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.network.os_vif_util [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55') {{(pid=72863) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG os_vif [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55') {{(pid=72863) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf4576f6-55, bridge=br-int, if_exists=True) {{(pid=72863) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:00 user nova-compute[72863]: INFO os_vif [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fa:01,bridge_name='br-int',has_traffic_filtering=True,id=bf4576f6-5564-4502-8ea9-c608dd3e5e6a,network=Network(806f0e12-8cbe-4548-babb-02213de4f161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf4576f6-55')
Aug 15 14:05:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Deleting instance files /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca_del
Aug 15 14:05:00 user nova-compute[72863]: INFO nova.virt.libvirt.driver [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Deletion of /opt/stack/data/nova/instances/f85f0542-0296-4866-a170-918b2fdd64ca_del complete
Aug 15 14:05:00 user nova-compute[72863]: INFO nova.compute.manager [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 14:05:00 user nova-compute[72863]: DEBUG oslo.service.loopingcall [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72863) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.compute.manager [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Deallocating network for instance {{(pid=72863) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 14:05:00 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] deallocate_for_instance() {{(pid=72863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG nova.network.neutron [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Updating instance_info_cache with network_info: [] {{(pid=72863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 14:05:01 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Took 0.87 seconds to deallocate network for instance.
Aug 15 14:05:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG nova.compute.manager [req-75272462-43c2-4431-a760-2fe6843a88a2 req-959d4b88-b4ab-4226-bf5d-4ca047bc5d67 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-deleted-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:05:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:01 user nova-compute[72863]: INFO nova.scheduler.client.report [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Deleted allocations for instance f85f0542-0296-4866-a170-918b2fdd64ca
Aug 15 14:05:01 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-10a73800-7ef3-432c-adfe-546cd943e95d tempest-TestMinimumBasicScenario-459527146 tempest-TestMinimumBasicScenario-459527146-project-member] Lock "f85f0542-0296-4866-a170-918b2fdd64ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 14:05:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] Acquiring lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:05:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:05:02 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] Lock "f85f0542-0296-4866-a170-918b2fdd64ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:02 user nova-compute[72863]: DEBUG nova.compute.manager [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] No waiting events found dispatching network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a {{(pid=72863) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 14:05:02 user nova-compute[72863]: WARNING nova.compute.manager [req-4bb2c5d2-9ffb-4528-aae9-b42ed55afe6f req-8e5c5f1e-ed53-4ee3-ab64-f033348796b2 service nova] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Received unexpected event network-vif-plugged-bf4576f6-5564-4502-8ea9-c608dd3e5e6a for instance with vm_state deleted and task_state None.
Aug 15 14:05:02 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:05 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:15 user nova-compute[72863]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692108300.4200842, f85f0542-0296-4866-a170-918b2fdd64ca => Stopped> {{(pid=72863) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 14:05:15 user nova-compute[72863]: INFO nova.compute.manager [-] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] VM Stopped (Lifecycle Event)
Aug 15 14:05:15 user nova-compute[72863]: DEBUG nova.compute.manager [None req-1736f0d3-63d0-4e3f-b3f4-c59384442bb9 None None] [instance: f85f0542-0296-4866-a170-918b2fdd64ca] Checking state {{(pid=72863) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 14:05:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:25 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:30 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:35 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:40 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:45 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager.update_available_resource {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Auditing locally available compute resources for user (node: user) {{(pid=72863) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 14:05:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:05:47 user nova-compute[72863]: WARNING nova.virt.libvirt.driver [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=25.396507263183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72863) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72863) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.provider_tree [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed in ProviderTree for provider: ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 {{(pid=72863) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.scheduler.client.report [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Inventory has not changed for provider ad4f7a2a-a80f-47dd-a7fe-ec3bbf5cca81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72863) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG nova.compute.resource_tracker [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Compute_service record updated for user:user {{(pid=72863) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 14:05:47 user nova-compute[72863]: DEBUG oslo_concurrency.lockutils [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:05:50 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:51 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:51 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72863) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 14:05:52 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:53 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:54 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:55 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:56 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:05:57 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:58 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:05:59 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:06:00 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:06:01 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:06:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Starting heal instance info cache {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 14:06:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Rebuilding the list of instances to heal {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 14:06:01 user nova-compute[72863]: DEBUG nova.compute.manager [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Didn't find any instances for network info cache update. {{(pid=72863) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 14:06:04 user nova-compute[72863]: DEBUG oslo_service.periodic_task [None req-cd299d64-9fc1-4dad-b7c7-4e80d2cbf0bb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 14:06:05 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:06:10 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:06:15 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72863) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72863) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 14:06:20 user nova-compute[72863]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72863) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}